At a Glance
- Tasks: Design and deliver scalable data solutions using Big Data technologies.
- Company: Join a renowned financial services organisation with a focus on innovation.
- Benefits: Flexible working options and opportunities for professional growth.
- Other info: Dynamic role with a focus on real-time data processing and analytics.
- Why this job: Make an impact by modernising data platforms and optimising processes.
- Qualifications: Expertise in Big Data, Hadoop, and data engineering required.
The predicted salary is between 36000 - 60000 £ per year.
Are you the right applicant for this opportunity? Find out by reading through the role overview below.
Your new company: Working for a renowned financial services organisation.
Your new role: We're looking for a Senior Data Engineer to design and deliver scalable on-prem, high-quality data solutions for low/high-level data platforms that power analytical and business insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining a leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs and modernising legacy ETL processes. You'll help design and build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem.
What you'll need to succeed:
- Vast Data Engineering expertise with Big Data technologies.
- Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design.
- Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning.
- Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools.
- Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB.
- Proven delivery of streaming pipelines and real-time data processing solutions.
- Improved job efficiency and reduced runtimes through Apache Spark optimisation and development.
- Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines.
- Delivered streaming pipelines and real-time data processing solutions.
- Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds.
- Proven background working within financial services environments.
What you'll get in return: Flexible working options available.
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
Senior Data Engineer Big Data/ Hadoop/ Spark employer: Hays Specialist Recruitment Limited
Contact Detail:
Hays Specialist Recruitment Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer Big Data/ Hadoop/ Spark
✨Tip Number 1
Network like a pro! Reach out to your connections in the financial services sector and let them know you're on the hunt for a Senior Data Engineer role. A personal recommendation can go a long way in landing that interview.
✨Tip Number 2
Show off your skills! Prepare a portfolio or a GitHub repository showcasing your projects with Hadoop, Spark, and other relevant technologies. This gives potential employers a tangible look at what you can do.
✨Tip Number 3
Ace the interview by practising common data engineering questions and scenarios. Be ready to discuss your experience with multi-node Hadoop clusters and real-time data processing solutions. Confidence is key!
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take the initiative to connect directly.
We think you need these skills to ace Senior Data Engineer Big Data/ Hadoop/ Spark
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with Big Data technologies and any relevant projects you've worked on, especially in financial services. We want to see how your skills align with what we're looking for!
Showcase Your Technical Skills: Don’t hold back on showcasing your technical expertise! Mention your hands-on experience with Hadoop, Spark, and other tools like Apache Airflow and Kafka. We love seeing specific examples of how you've used these technologies to solve real-world problems.
Keep It Clear and Concise: When writing your application, keep it clear and concise. Use bullet points where possible to make it easy for us to read through your qualifications. Remember, we’re looking for clarity in your experience and achievements!
Apply Through Our Website: We encourage you to apply through our website for a smoother process. This way, we can easily track your application and get back to you quicker. Plus, it shows you're keen on joining our team at StudySmarter!
How to prepare for a job interview at Hays Specialist Recruitment Limited
✨Know Your Tech Inside Out
Make sure you’re well-versed in the Big Data technologies mentioned in the job description, like Hadoop, Spark, and Apache Airflow. Brush up on your hands-on experience with these tools, as you might be asked to discuss specific projects or challenges you've faced using them.
✨Showcase Your Problem-Solving Skills
Prepare to share examples of how you've tackled complex data engineering problems, especially in financial services. Think about times when you improved job efficiency or reduced runtimes through optimisation techniques, and be ready to explain your thought process.
✨Understand the Business Context
Since this role is within a financial services organisation, it’s crucial to understand how data engineering impacts business insights. Familiarise yourself with the company’s strategic initiatives, particularly around metals, and be prepared to discuss how your work can contribute to their goals.
✨Ask Insightful Questions
Interviews are a two-way street, so come prepared with questions that show your interest in the role and the company. Ask about their current data platforms, challenges they face, or how they envision the future of their data strategy. This not only demonstrates your enthusiasm but also helps you gauge if the company is the right fit for you.