At a Glance
- Tasks: Design and maintain data pipelines using Databricks and Apache Spark.
- Company: Join a forward-thinking company offering fully remote work.
- Benefits: Earn Β£400-500 per day with flexible hours and a 6-month contract.
- Why this job: Make an impact by optimising data workflows and collaborating with analytics teams.
- Qualifications: 3+ years as a Data Engineer with strong Databricks and Python skills.
- Other info: Great opportunity for career growth in a dynamic, tech-driven environment.
The predicted salary is between 80000 - 120000 Β£ per year.
We are currently recruiting a Data Engineer for one of our clients. The role is outside IR35 and is paying Β£400-500 per day, it will initially be for 6 months. It is also fully remote.
Key Responsibilities
- Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark)
- Build and optimize ETL/ELT workflows for large-scale structured and unstructured data
- Implement Delta Lake architectures (Bronze/Silver/Gold layers)
- Integrate data from multiple sources (databases, APIs, event streams, files)
- Optimize Spark jobs for performance, scalability, and cost
- Manage data quality, validation, and monitoring
- Collaborate with analytics and ML teams to support reporting and model development
- Implement CI/CD, version control, and automated testing for data pipelines
Required Qualifications
- 3+ years of experience as a Data Engineer
- Strong experience with Databricks and Apache Spark
- Proficiency in Python (required); SQL (advanced)
- Hands-on experience with AWS or Azure cloud services:
- AWS: S3, EMR, Glue, Redshift, Lambda, IAM
- Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault
Data Engineer in London employer: Searches @ Wenham Carter
Contact Detail:
Searches @ Wenham Carter Recruiting Team
StudySmarter Expert Advice π€«
We think this is how you could land Data Engineer in London
β¨Tip Number 1
Network like a pro! Reach out to fellow Data Engineers or join relevant online communities. You never know who might have the inside scoop on job openings or can refer you directly.
β¨Tip Number 2
Show off your skills! Create a portfolio showcasing your data pipelines, ETL workflows, and any projects using Databricks or Apache Spark. This will give potential employers a taste of what you can do.
β¨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with AWS or Azure services and how you've optimised Spark jobs in the past. Practice makes perfect!
β¨Tip Number 4
Don't forget to apply through our website! We make it easy for you to find roles that match your skills and experience. Plus, weβre here to support you every step of the way.
We think you need these skills to ace Data Engineer in London
Some tips for your application π«‘
Tailor Your CV: Make sure your CV is tailored to the Data Engineer role. Highlight your experience with Databricks, Apache Spark, and any relevant cloud services like AWS or Azure. We want to see how your skills match what we're looking for!
Showcase Your Projects: Include specific projects where you've designed and maintained data pipelines or worked with ETL/ELT workflows. This gives us a clear picture of your hands-on experience and problem-solving skills in action.
Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for key achievements and responsibilities. We appreciate straightforwardness and clarity in your communication!
Apply Through Our Website: Donβt forget to apply through our website! Itβs the best way for us to receive your application and ensures youβre considered for the role. We canβt wait to see what you bring to the table!
How to prepare for a job interview at Searches @ Wenham Carter
β¨Know Your Tech Stack
Make sure youβre well-versed in Databricks, Apache Spark, and the cloud services mentioned in the job description. Brush up on your Python and SQL skills, as these will likely come up during technical discussions.
β¨Showcase Your Projects
Prepare to discuss specific projects where you've designed and maintained data pipelines. Highlight your experience with ETL/ELT workflows and how youβve optimised them for performance and cost. Real-world examples will impress your interviewers!
β¨Understand Delta Lake Architecture
Familiarise yourself with the Bronze/Silver/Gold layers of Delta Lake. Be ready to explain how youβve implemented these architectures in past roles and the benefits they bring to data management.
β¨Collaboration is Key
Since the role involves working with analytics and ML teams, be prepared to discuss how youβve collaborated with other departments in previous jobs. Emphasise your communication skills and how you ensure data quality and validation across teams.