Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and build of advanced data platforms for tackling fraud in finance.
- Company: Join a high-performing team at a leading financial tech firm.
- Benefits: Competitive day rate, flexible work environment, and opportunity for professional growth.
- Other info: Hands-on leadership role with excellent career advancement opportunities.
- Why this job: Make a real impact by delivering scalable data solutions using cutting-edge cloud technologies.
- Qualifications: Strong experience in data engineering with expertise in AWS, Databricks, and SQL.
Location: London (2 days onsite per week)
Day Rate: £525-550 Per day (Outside IR35)
Duration: min. 6-month contract
Start: ASAP
Overview
We are looking for a Lead Data Engineer to join a high-performing team delivering advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture, enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership position focused on building robust, scalable, and governed data solutions using modern cloud technologies.
The Role
- Own the end-to-end design, build, optimisation, and support of scalable Spark / PySpark data pipelines (batch and streaming)
- Define and implement lakehouse architecture standards (medallion model: bronze, silver, gold), including governance, lineage, and data quality controls
- Design and manage secure data ingestion frameworks (e.g. Apache NiFi, APIs, SFTP/FTPS) for internal and external data sources
- Architect and maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.)
- Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions
- Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation)
- Drive CI/CD best practices for data platforms (infrastructure as code, automated testing, versioning, environment promotion)
- Mentor engineers on distributed data processing, performance optimisation, and cost efficiency
- Collaborate with data science, product, and compliance teams to translate requirements into scalable data solutions
Required Skills & Experience
- Strong experience as a Senior or Lead Data Engineer with ownership of end-to-end data solutions
- Expertise in Databricks, PySpark / Spark, SQL, and Python
- Proven experience building and optimising large-scale data pipelines in production environments
- Strong knowledge of cloud data architectures, particularly within AWS
- Experience designing scalable data models and reusable frameworks
- Hands-on experience with orchestration tools such as Airflow or similar
- Solid understanding of data governance, lineage, and compliance requirements
- Experience with CI/CD pipelines and infrastructure as code (e.g. Terraform, CloudFormation)
- Strong communication skills with the ability to collaborate across technical and non-technical teams
What We’re Looking For
- A hands-on technical leader who can design, build, and deliver solutions independently
- Someone comfortable working with high-volume, high-throughput data systems
- Strong problem-solving skills and a pragmatic, delivery-focused mindset
- Experience mentoring engineers and setting engineering standards and best practices
- Ability to balance technical excellence with delivery timelines
Lead Data Engineer SQL AWS employer: Forsyth Barnes
Contact Detail:
Forsyth Barnes Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer SQL AWS
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the role you want. Building relationships can lead to insider info on job openings and even referrals.
✨Show Off Your Skills
When you get the chance to chat with potential employers, don’t hold back! Share your past projects, especially those involving Databricks, AWS, and data pipelines. Use real examples to demonstrate how you’ve tackled challenges and delivered results.
✨Tailor Your Approach
Every company is different, so make sure you tailor your pitch to match their needs. Research the company’s tech stack and challenges, and be ready to discuss how your experience aligns with their goals, especially around data governance and cloud architecture.
✨Apply Through Our Website
Don’t forget to check out our website for the latest job openings! Applying directly through us not only shows your interest but also gives you a better chance of being noticed by our hiring team. Let’s get you that Lead Data Engineer role!
We think you need these skills to ace Lead Data Engineer SQL AWS
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with Databricks, AWS, and building scalable data pipelines. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for our team. Mention specific projects where you've led data solutions and how you’ve tackled challenges in the past.
Showcase Your Technical Skills: Don’t hold back on showcasing your technical expertise! Include details about your experience with PySpark, SQL, and cloud architectures. We love seeing hands-on experience, so be specific about your contributions.
Apply Through Our Website: We encourage you to apply through our website for a smoother process. It helps us keep track of applications and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at Forsyth Barnes
✨Know Your Tech Inside Out
Make sure you’re well-versed in Databricks, PySpark, SQL, and AWS. Brush up on your knowledge of data architectures and be ready to discuss how you've implemented scalable data solutions in the past. Prepare examples that showcase your hands-on experience with these technologies.
✨Showcase Your Leadership Skills
As a Lead Data Engineer, you'll need to demonstrate your ability to mentor and guide others. Think of specific instances where you've led a project or helped a colleague overcome a challenge. Be prepared to discuss how you set engineering standards and best practices.
✨Prepare for Problem-Solving Questions
Expect to face technical challenges during the interview. Practice explaining your thought process when tackling complex data problems. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight your problem-solving skills.
✨Understand the Business Context
Since this role involves working with financial institutions, it’s crucial to understand the implications of data governance and compliance. Familiarise yourself with the challenges these organisations face regarding fraud and financial crime, and think about how your work can contribute to solving these issues.