Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead an Agile team in migrating data and building ETL workflows.
- Company: Join a dynamic company focused on innovative cloud solutions.
- Benefits: Enjoy hybrid work, flexible hours, and opportunities for professional growth.
- Why this job: Be part of a cutting-edge project that enhances your skills and leadership experience.
- Qualifications: Strong SQL, Python, and Azure experience required; leadership skills a must.
- Other info: This is a long-term contract role based in Sheffield.
The predicted salary is between 48000 - 72000 £ per year.
Duration: long-term contract
Location: Hybrid (3 days/week from Sheffield)
Visa: UK Citizen/ILR/Dependent visa (No Visa sponsorship)
We are looking for a Senior Data Engineer with hands-on expertise in SQL/BigQuery migration, Azure Databricks, and Spark SQL, who also brings team leadership experience and thrives in Agile/SAFe/Scrum environments.
Key Responsibilities:
- Lead and contribute to a small Agile team working on a cross-cloud data migration project.
- Migrate complex BigQuery SQL transformations to Spark SQL on Azure.
- Build & execute ETL workflows using Azure Databricks and Python.
- Drive automation of SQL workflows and artefact migration across cloud providers.
- Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization.
Key Requirements:
- Strong SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development.
- Experience with Azure and cloud data tools.
- Familiarity with CI/CD practices and automation.
- Proven team leadership and organisational capabilities.
- Comfortable with Agile/SAFe/PI Planning methodologies.
Senior Data Engineer (Azure, Spark SQL, Team Lead) employer: HOK Consulting - Technical Recruitment Consultancy
Contact Detail:
HOK Consulting - Technical Recruitment Consultancy Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer (Azure, Spark SQL, Team Lead)
✨Tip Number 1
Familiarise yourself with Azure Databricks and Spark SQL by working on personal projects or contributing to open-source initiatives. This hands-on experience will not only enhance your skills but also demonstrate your commitment to the role.
✨Tip Number 2
Network with professionals in the data engineering field, especially those who have experience with Agile methodologies. Attend meetups or webinars to gain insights and potentially get referrals that could help you land the job.
✨Tip Number 3
Brush up on your leadership skills by taking on team projects or mentoring others in your current role. Highlight these experiences during interviews to showcase your ability to lead a team effectively.
✨Tip Number 4
Stay updated on the latest trends in cloud data tools and CI/CD practices. Engaging with relevant online communities or forums can provide valuable insights and help you discuss these topics confidently during interviews.
We think you need these skills to ace Senior Data Engineer (Azure, Spark SQL, Team Lead)
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with SQL, BigQuery, Spark SQL, and Azure Databricks. Emphasise any leadership roles you've held and your familiarity with Agile methodologies.
Craft a Compelling Cover Letter: In your cover letter, explain why you're the perfect fit for the Senior Data Engineer role. Mention specific projects where you've successfully led teams or migrated data, showcasing your hands-on expertise.
Showcase Relevant Projects: If you have worked on similar cross-cloud data migration projects, include them in your application. Detail your role, the technologies used, and the outcomes achieved to demonstrate your capabilities.
Highlight Soft Skills: Since this role involves team leadership, make sure to highlight your communication and collaboration skills. Provide examples of how you've worked effectively within Agile teams to deliver quality results.
How to prepare for a job interview at HOK Consulting - Technical Recruitment Consultancy
✨Showcase Your Technical Skills
Be prepared to discuss your hands-on experience with SQL, BigQuery, and Spark SQL. Bring examples of past projects where you successfully migrated data or built ETL workflows using Azure Databricks and Python.
✨Demonstrate Leadership Experience
Since the role requires team leadership, share specific instances where you led a team in an Agile environment. Highlight how you motivated your team and contributed to successful project outcomes.
✨Familiarise Yourself with Agile Methodologies
Brush up on Agile, SAFe, and Scrum principles. Be ready to discuss how you've applied these methodologies in previous roles and how they can benefit the team and project at hand.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving skills in real-world scenarios. Think about challenges you've faced in data migration or automation and how you overcame them, as this will demonstrate your critical thinking and adaptability.
