Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and optimise scalable data pipelines using Databricks and collaborate with teams.
- Company: Join a forward-thinking company that values innovation and teamwork.
- Benefits: Enjoy remote work, competitive pay, and opportunities for professional growth.
- Why this job: Make an impact by delivering high-quality data solutions in a dynamic environment.
- Qualifications: Experience with Databricks, PySpark, SQL, and strong communication skills.
- Other info: Ideal for self-sufficient individuals ready to lead in fast-paced settings.
The predicted salary is between 36000 - 60000 £ per year.
We're seeking an experienced Databricks specialist to design, build, and optimise scalable data pipelines. You'll work closely with business and analytics teams to deliver high-quality, reliable, and well-governed data solutions, while championing modern DataOps practices. This role is remote but you must be UK based.
Responsibilities
- Build and maintain Databricks-based data pipelines (PySpark, Delta Lake, SQL).
- Integrate data from APIs, databases, and file systems.
- Work with stakeholders to translate requirements into engineering solutions.
- Ensure data quality, reliability, security, and governance.
- Implement Git, CI/CD, automated testing, and Infrastructure as Code (IaC).
- Optimise Databricks jobs, clusters, and workflows.
- Document processes and best practices.
Required Skills
- Strong experience with Databricks, PySpark, Delta Lake, and SQL.
- Advanced Python and SQL for data transformation.
- Solid understanding of ETL/ELT, data warehousing, and distributed processing.
- Hands-on with DataOps: Git, CI/CD, testing, IaC.
- Experience with AWS, Azure, or GCP.
- Strong troubleshooting and performance optimisation skills.
The ideal candidate will be
- Self-sufficient contractor comfortable leading technical decisions.
- Strong communicator who collaborates well with business and analytics teams.
- Delivery-focused, pragmatic, and experienced in fast-moving environments.
Data Engineer (Databricks Specialist) employer: iO Associates
Contact Detail:
iO Associates Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer (Databricks Specialist)
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Databricks. A friendly chat can lead to insider info about job openings that might not even be advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best Databricks projects. Whether it's a GitHub repo or a personal website, having tangible examples of your work can really impress potential employers.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges with Databricks, PySpark, and data governance. Practice makes perfect!
✨Tip Number 4
Don’t forget to apply through our website! We love seeing candidates who are genuinely interested in joining our team. Plus, it’s a great way to ensure your application gets the attention it deserves.
We think you need these skills to ace Data Engineer (Databricks Specialist)
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Databricks, PySpark, and SQL. We want to see how your skills align with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how you can contribute to our team. We love seeing enthusiasm and a bit of personality!
Showcase Your DataOps Knowledge: Since we’re all about modern DataOps practices, make sure to mention your experience with Git, CI/CD, and Infrastructure as Code. We’re keen to know how you’ve implemented these in past roles!
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at iO Associates
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks skills before the interview. Be ready to discuss your experience with building and optimising data pipelines using PySpark, Delta Lake, and SQL. Prepare examples of past projects where you successfully implemented these technologies.
✨Showcase Your DataOps Knowledge
Since this role emphasises modern DataOps practices, be prepared to talk about your experience with Git, CI/CD, and Infrastructure as Code (IaC). Share specific instances where you’ve used these tools to improve data workflows or enhance collaboration with teams.
✨Communicate Clearly with Stakeholders
As a Data Engineer, you'll need to work closely with business and analytics teams. Practice explaining complex technical concepts in simple terms. Think of examples where you translated stakeholder requirements into engineering solutions, showcasing your strong communication skills.
✨Prepare for Problem-Solving Questions
Expect to face questions that test your troubleshooting and performance optimisation skills. Review common challenges in data engineering and think through how you would approach solving them. Being able to articulate your thought process will impress your interviewers.
