At a Glance
- Tasks: Lead the design and build of advanced data platforms for tackling financial crime.
- Company: Join a high-performing team in a dynamic tech environment.
- Benefits: Competitive day rate, flexible work schedule, and opportunity for professional growth.
- Other info: Hands-on leadership role with excellent career advancement opportunities.
- Why this job: Make a real impact by delivering scalable data solutions using cutting-edge technologies.
- Qualifications: Strong experience in data engineering, Databricks, and cloud architectures.
The predicted salary is between 132000 - 132000 € per year.
Location: London (2 days onsite per week)
Day Rate: £550 Per day (Outside IR35)
Duration: min. 6-month contract
Start: ASAP
Contact: Matthew.Makranczy@forsythbarnes.com
Overview
We are looking for a Lead Data Engineer to join a high-performing team delivering advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + lakehouse architecture, enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership position focused on building robust, scalable, and governed data solutions using modern cloud technologies.
The Role
- Own the end-to-end design, build, optimisation, and support of scalable Spark / PySpark data pipelines (batch and streaming)
- Define and implement lakehouse architecture standards (medallion model: bronze, silver, gold), including governance, lineage, and data quality controls
- Design and manage secure data ingestion frameworks (e.g. Apache NiFi, APIs, SFTP/FTPS) for internal and external data sources
- Architect and maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.)
- Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions
- Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation)
- Drive CI/CD best practices for data platforms (infrastructure as code, automated testing, versioning, environment promotion)
- Mentor engineers on distributed data processing, performance optimisation, and cost efficiency
- Collaborate with data science, product, and compliance teams to translate requirements into scalable data solutions
Required Skills & Experience
- Strong experience as a Senior or Lead Data Engineer with ownership of end-to-end data solutions
- Expertise in Databricks, PySpark / Spark, SQL, and Python
- Proven experience building and optimising large-scale data pipelines in production environments
- Strong knowledge of cloud data architectures, particularly within AWS
- Experience designing scalable data models and reusable frameworks
- Hands-on experience with orchestration tools such as Airflow or similar
- Solid understanding of data governance, lineage, and compliance requirements
- Experience with CI/CD pipelines and infrastructure as code (e.g. Terraform, CloudFormation)
- Strong communication skills with the ability to collaborate across technical and non-technical teams
What We’re Looking For
- A hands-on technical leader who can design, build, and deliver solutions independently
- Someone comfortable working with high-volume, high-throughput data systems
- Strong problem-solving skills and a pragmatic, delivery-focused mindset
- Experience mentoring engineers and setting engineering standards and best practices
- Ability to balance technical excellence with delivery timelines
Lead Engineer/Data Engineer employer: Forsyth Barnes
Join a dynamic and innovative team in London as a Lead Data Engineer, where you'll have the opportunity to work on cutting-edge data platforms that combat fraud and financial crime. With a strong emphasis on employee growth, collaboration, and a supportive work culture, this role offers competitive day rates and the flexibility of hybrid working. You'll be part of a forward-thinking environment that champions technical excellence and provides ample opportunities for mentorship and professional development.
StudySmarter Expert Advice🤫
We think this is how you could land Lead Engineer/Data Engineer
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the role you want. Building relationships can lead to job opportunities that aren’t even advertised.
✨Show Off Your Skills
Don’t just talk about your experience; showcase it! Create a portfolio or GitHub repository with projects that highlight your expertise in Databricks, PySpark, and AWS. This gives potential employers a tangible look at what you can do.
✨Ace the Interview
Prepare for interviews by practising common questions related to data engineering and your specific skills. Use the STAR method (Situation, Task, Action, Result) to structure your answers and demonstrate your problem-solving abilities.
✨Apply Through Our Website
Make sure to apply through our website for the best chance of landing that Lead Data Engineer role. We’re always on the lookout for talented individuals like you, and applying directly helps us see your application faster!
We think you need these skills to ace Lead Engineer/Data Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with Databricks, PySpark, and AWS, as these are key skills we're looking for. Use specific examples that showcase your ability to design and optimise data pipelines.
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Share your passion for data engineering and how your background aligns with our mission at StudySmarter. Don’t forget to mention any leadership experience you have, as this role is all about hands-on leadership.
Showcase Your Projects:If you've worked on relevant projects, make sure to include them in your application. Whether it's building scalable data solutions or implementing CI/CD best practices, we want to see what you've accomplished. Real-world examples can really set you apart!
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of applications and ensures you don’t miss out on any important updates. Plus, it shows you're keen on joining our team!
How to prepare for a job interview at Forsyth Barnes
✨Know Your Tech Inside Out
Make sure you’re well-versed in Databricks, PySpark, and AWS. Brush up on your knowledge of data pipelines and lakehouse architecture. Be ready to discuss specific projects where you've implemented these technologies.
✨Showcase Your Leadership Skills
As a Lead Data Engineer, you'll need to demonstrate your ability to mentor and guide others. Prepare examples of how you've led teams or improved processes in previous roles. Highlight your experience in setting engineering standards and best practices.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving skills. Think about challenges you've faced with data governance or pipeline optimisation and how you tackled them. Use the STAR method (Situation, Task, Action, Result) to structure your answers.
✨Communicate Clearly and Collaboratively
You’ll be working with both technical and non-technical teams, so practice explaining complex concepts in simple terms. Show that you can bridge the gap between different departments and foster collaboration.
