Data Engineer

Data Engineer

Temporary Home office (partial)
Omnis Partners

At a Glance

  • Tasks: Migrate data pipelines to Databricks and optimise workflows using PySpark.
  • Company: Join a leading Databricks Delivery Partner in a dynamic consulting environment.
  • Benefits: Competitive pay, flexible work schedule, and hands-on experience with cutting-edge tech.
  • Other info: Short-term contract with potential for future opportunities.
  • Why this job: Make an impact on high-stakes projects while developing your skills in data engineering.
  • Qualifications: Databricks Certified with strong PySpark and SQL skills required.

We’re supporting a Databricks Delivery Partner on a short-term, high-impact migration engagement and are looking for a strong hands-on Databricks Data Engineer to join the project immediately.

This piece of work will focus on migrating data tables and ETL workflows from AWS Glue into Databricks, working closely with an experienced delivery team in a fast-paced consulting environment.

The Role

  • Migrate existing data pipelines and tables into Databricks
  • Build and optimise scalable PySpark-based data workflows
  • Support Lakehouse and Delta architecture implementation
  • Work across ETL orchestration, transformation and optimisation
  • Collaborate directly with technical stakeholders and delivery teams

Required Experience

  • You must be Databricks Partner Programme vetted to be considered for the role
  • Experience within a Databricks Delivery Partner / consulting environment
  • Databricks Certified
  • Strong PySpark / Spark / SQL capability
  • Experience with ETL and data migration projects
  • Exposure to orchestration tooling such as AWS Glue or Azure Data Factory
  • Comfortable delivering in fast-moving project environments

Drop me a message or email to find out more - helen.graham@omnis.partners

Data Engineer employer: Omnis Partners

Join a dynamic and innovative team as a Databricks Data Engineer in London, where you'll have the opportunity to work on high-impact projects in a fast-paced consulting environment. Our company fosters a collaborative work culture that values employee growth and development, offering unique opportunities to enhance your skills while working alongside experienced professionals. With flexible onsite requirements and a focus on cutting-edge technology, we provide an engaging workplace that empowers you to make a meaningful impact.
Omnis Partners

Contact Detail:

Omnis Partners Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Engineer

✨Tip Number 1

Network like a pro! Reach out to your connections in the data engineering field, especially those who have experience with Databricks. A friendly chat can lead to insider info about job openings or even referrals.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your previous projects, especially those involving PySpark and ETL workflows. This will give potential employers a taste of what you can bring to the table.

✨Tip Number 3

Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with AWS Glue and data migration projects. We want you to feel confident and ready to impress!

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we’re always looking for talented individuals like you to join our team.

We think you need these skills to ace Data Engineer

Databricks
PySpark
Spark
SQL
ETL
Data Migration
AWS Glue
Azure Data Factory
Data Workflows
Lakehouse Architecture
Delta Architecture
Orchestration Tooling
Consulting Environment
Collaboration Skills

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with Databricks, PySpark, and any relevant ETL projects. We want to see how your skills match the job description, so don’t be shy about showcasing your achievements!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this role. Mention your hands-on experience with data migration and how you thrive in fast-paced environments, just like the one we’re offering.

Showcase Relevant Projects: If you've worked on similar projects, make sure to include them in your application. We love seeing real-world examples of your work, especially if they involve migrating data or using Databricks. It helps us understand your practical experience!

Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates. Plus, it shows you’re keen to join our team!

How to prepare for a job interview at Omnis Partners

✨Know Your Databricks Inside Out

Make sure you brush up on your Databricks knowledge before the interview. Familiarise yourself with its features, especially around data migration and ETL workflows. Being able to discuss your hands-on experience with Databricks and how you've used it in past projects will show you're the right fit for the role.

✨Show Off Your PySpark Skills

Since strong PySpark capability is a must-have, prepare to discuss specific examples of how you've built and optimised data workflows using PySpark. Be ready to explain your thought process and any challenges you faced during implementation. This will demonstrate your technical prowess and problem-solving skills.

✨Understand the Project Environment

Get a good grasp of what a fast-paced consulting environment entails. Think about your previous experiences in similar settings and be prepared to share how you managed tight deadlines and collaborated with teams. This will highlight your adaptability and teamwork skills, which are crucial for this role.

✨Prepare Questions for the Interviewers

Interviews are a two-way street, so come armed with insightful questions about the project and the team you'll be working with. Ask about their current challenges with data migration or how they envision the Lakehouse architecture evolving. This shows your genuine interest in the role and helps you assess if it's the right fit for you.

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>