At a Glance
- Tasks: Design and deliver scalable data solutions using Big Data technologies.
- Company: Renowned financial services organisation with a focus on innovation.
- Benefits: Flexible working options and opportunities for professional growth.
- Other info: Hands-on role with a dynamic team and exciting projects.
- Why this job: Join a strategic initiative to modernise data platforms and make a real impact.
- Qualifications: Expertise in Big Data, Hadoop, and data engineering within financial services.
The predicted salary is between 36000 - 60000 £ per year.
Your new company
Working for a renowned financial services organisation.
Your new role
We're looking for a Senior Data Engineer to design and deliver scalable on-prem, high-quality data solutions for low/high-level data platforms that power analytical and business insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining a leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs and modernising legacy ETL processes. You'll help design and build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem.
What you'll need to succeed
- Vast Data Engineering expertise with Big Data technologies.
- Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design.
- Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning.
- Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools.
- Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB.
- Proven delivery of streaming pipelines and real-time data processing solutions.
- Improved job efficiency and reduced runtimes through Apache Spark optimisation and development.
- Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines.
- Delivered streaming pipelines and real-time data processing solutions.
- Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds.
- Proven background working within financial services environments.
What you'll get in return
Flexible working options available.
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
Senior Data Engineer Big Data/ Hadoop/ Spark in London employer: Hays Specialist Recruitment Limited
Contact Detail:
Hays Specialist Recruitment Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer Big Data/ Hadoop/ Spark in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the financial services sector and let them know you're on the hunt for a Senior Data Engineer role. A personal recommendation can go a long way in landing that interview.
✨Tip Number 2
Show off your skills! Prepare a portfolio or a GitHub repository showcasing your projects with Hadoop, Spark, and other relevant technologies. This hands-on evidence of your expertise can really impress potential employers.
✨Tip Number 3
Ace the interview by practising common data engineering questions. Brush up on your knowledge of data pipelines, ETL processes, and big data tools. We recommend doing mock interviews with friends or using online platforms to get comfortable.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who take the initiative to connect directly with us.
We think you need these skills to ace Senior Data Engineer Big Data/ Hadoop/ Spark in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Big Data technologies and data engineering. We want to see how your skills align with the role, so don’t be shy about showcasing your hands-on experience with Hadoop, Spark, and other relevant tools.
Craft a Compelling Cover Letter: Your cover letter is your chance to tell us why you’re the perfect fit for this role. Share specific examples of your past projects, especially those that involved designing on-prem data platforms or optimising ETL processes. Let your passion for data engineering shine through!
Showcase Your Problem-Solving Skills: In your application, highlight instances where you've tackled complex data challenges. We love seeing how you’ve improved job efficiency or reduced runtimes using Apache Spark or similar technologies. It’s all about demonstrating your impact!
Apply Through Our Website: We encourage you to apply directly through our website for a smoother process. This way, we can easily track your application and get back to you quicker. Plus, it shows us you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at Hays Specialist Recruitment Limited
✨Know Your Tech Inside Out
Make sure you’re well-versed in the Big Data technologies mentioned in the job description, like Hadoop, Spark, and Apache Airflow. Brush up on your hands-on experience with these tools, as you might be asked to discuss specific projects or challenges you've faced using them.
✨Showcase Your Problem-Solving Skills
Prepare to share examples of how you've tackled complex data engineering problems, especially in financial services. Think about times when you improved job efficiency or reduced runtimes through optimisation techniques, and be ready to explain your thought process.
✨Understand the Business Context
Since this role is within a financial services organisation, it’s crucial to understand the industry’s data needs. Familiarise yourself with how data impacts trading, commodities, and metals, and be prepared to discuss how your work can contribute to strategic initiatives.
✨Ask Insightful Questions
At the end of the interview, don’t shy away from asking questions that show your interest in the role and the company. Inquire about their current data platforms, challenges they face, or how they envision the future of their data strategy. This not only shows your enthusiasm but also helps you gauge if the company is the right fit for you.