Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and optimise scalable data pipelines using Databricks and collaborate with teams.
- Company: Join a forward-thinking company that values innovation and teamwork.
- Benefits: Enjoy remote work, competitive pay, and opportunities for professional growth.
- Why this job: Make an impact by delivering high-quality data solutions in a dynamic environment.
- Qualifications: Experience with Databricks, PySpark, SQL, and strong communication skills.
- Other info: Ideal for self-sufficient contractors looking to lead in a fast-paced setting.
The predicted salary is between 36000 - 60000 £ per year.
We're seeking an experienced Databricks specialist to design, build, and optimise scalable data pipelines. You'll work closely with business and analytics teams to deliver high-quality, reliable, and well-governed data solutions, while championing modern DataOps practices. This role is remote but you must be UK based.
Responsibilities
- Build and maintain Databricks-based data pipelines (PySpark, Delta Lake, SQL).
- Integrate data from APIs, databases, and file systems.
- Work with stakeholders to translate requirements into engineering solutions.
- Ensure data quality, reliability, security, and governance.
- Implement Git, CI/CD, automated testing, and Infrastructure as Code (IaC).
- Optimise Databricks jobs, clusters, and workflows.
- Document processes and best practices.
Required Skills
- Strong experience with Databricks, PySpark, Delta Lake, and SQL.
- Advanced Python and SQL for data transformation.
- Solid understanding of ETL/ELT, data warehousing, and distributed processing.
- Hands-on with DataOps: Git, CI/CD, testing, IaC.
- Experience with AWS, Azure, or GCP.
- Strong troubleshooting and performance optimisation skills.
The ideal candidate will be
- Self-sufficient contractor comfortable leading technical decisions.
- Strong communicator who collaborates well with business and analytics teams.
- Delivery-focused, pragmatic, and experienced in fast-moving environments.
Data Engineer (Databricks Specialist) in London employer: iO Associates
Contact Detail:
iO Associates Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer (Databricks Specialist) in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Databricks. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best Databricks projects. Whether it's a GitHub repo or a personal website, having tangible examples of your work can really impress potential employers.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges with PySpark or optimised data pipelines. We want you to shine and show them you're the right fit!
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Engineer (Databricks Specialist) in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Databricks, PySpark, and SQL. We want to see how your skills align with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how you can contribute to our team. Keep it concise but impactful – we love a good story!
Showcase Your DataOps Knowledge: Since we’re all about modern DataOps practices, make sure to mention your experience with Git, CI/CD, and Infrastructure as Code. We’re looking for someone who can hit the ground running, so highlight any hands-on experience you have.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates. Plus, we love seeing applications come in through our own channels!
How to prepare for a job interview at iO Associates
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building and optimising data pipelines using PySpark, Delta Lake, and SQL. Prepare examples of past projects where you successfully implemented these technologies.
✨Showcase Your DataOps Skills
Since this role emphasises modern DataOps practices, be prepared to talk about your experience with Git, CI/CD, and Infrastructure as Code (IaC). Share specific instances where you’ve used these tools to improve data quality and streamline processes.
✨Communicate Clearly with Stakeholders
As a Data Engineer, you'll need to work closely with business and analytics teams. Practice explaining complex technical concepts in simple terms. Think of examples where you translated stakeholder requirements into effective engineering solutions.
✨Demonstrate Problem-Solving Skills
Be ready to discuss how you've tackled troubleshooting and performance optimisation challenges in the past. Prepare to share specific scenarios where your analytical skills made a significant impact on project outcomes.
