Senior Azure Data Engineer (Databricks + GenAI)
Senior Azure Data Engineer (Databricks + GenAI)

Senior Azure Data Engineer (Databricks + GenAI)

Full-Time 70000 - 90000 £ / year (est.) Home office possible
T

At a Glance

  • Tasks: Lead data engineering projects using Azure Databricks and GenAI technologies.
  • Company: Join a forward-thinking tech company focused on innovation and collaboration.
  • Benefits: Enjoy remote work, competitive salary, and opportunities for professional growth.
  • Other info: Dynamic role with mentorship opportunities and a focus on best practices.
  • Why this job: Make an impact by building cutting-edge data platforms that drive analytics and AI.
  • Qualifications: 8+ years in data engineering with strong Azure Databricks and Python skills.

The predicted salary is between 70000 - 90000 £ per year.

Location: UK Remote

Engagement: Permanent

Overview: We are seeking a Senior Azure Data Engineer to take ownership of the data engineering capability across multiple enterprise-scale Azure Databricks programmes. This role sits at the intersection of data engineering, cloud architecture, and GenAI enablement, building production-grade lakehouse platforms that power analytics, automation, and AI-driven applications. You will act as a technical lead and client-facing engineer, responsible for designing, delivering, and governing scalable Azure + Databricks data platforms.

Key Responsibilities:

  • Architecture Leadership
    • Define Azure Databricks lakehouse architectures (medallion model)
    • Review and approve engineering designs across projects
  • Data Engineering Delivery
    • Build end-to-end pipelines using: Azure Databricks (PySpark, Delta Lake, Workflows), Azure Data Factory / Synapse Pipelines, ADLS Gen2
    • Deliver curated data products (bronze / silver / gold)
  • GenAI Enablement
    • Prepare data for RAG and AI workloads
    • Work with Azure OpenAI + Azure AI Search
    • Implement embedding, chunking, and retrieval strategies
  • CI/CD & Infrastructure
    • Implement IaC using Terraform or Bicep
    • Manage CI/CD pipelines using Azure DevOps or GitHub Actions
    • Use Databricks Asset Bundles for deployment automation
  • Governance & Security
    • Implement Unity Catalog, Purview, RBAC, and data lineage
    • Ensure secure-by-design architecture (Key Vault, Entra ID)
  • Client Engagement
    • Lead workshops, design sessions, and technical discussions
    • Translate business requirements into structured engineering delivery
  • Mentorship
    • Guide and support mid-level engineers
    • Enforce engineering standards and best practices

Required Experience:

  • 8+ years in data engineering
  • 4+ years hands-on Azure data platform experience
  • Expert-level Azure Databricks (PySpark, Delta Lake, Jobs, tuning)
  • Strong Azure Data Factory / ADLS Gen2 / Azure SQL experience
  • Solid Python and SQL engineering background
  • Experience with lakehouse / medallion architecture
  • CI/CD & IaC (Terraform or Bicep + Azure DevOps/GitHub Actions)
  • Understanding of Azure AI Search / Azure OpenAI / RAG concepts
  • Experience with Unity Catalog / Purview / data governance frameworks

Soft Skills:

  • Strong client-facing communication skills
  • Confident leading technical design discussions
  • Ability to manage ambiguity and define structure
  • Mentoring and leadership capability

Nice to Have:

  • Power BI / Fabric experience
  • Salesforce data integration experience
  • Microsoft certifications (DP-203, DP-700, AZ-305, etc.)
  • Experience in real-time or operational data environments
  • Exposure to Data/AI Centre of Excellence environments

Senior Azure Data Engineer (Databricks + GenAI) employer: TECHNOLOGY AND RISK RECRUITMENT LTD

As a Senior Azure Data Engineer with us, you'll thrive in a dynamic and inclusive work culture that prioritises innovation and collaboration. We offer competitive benefits, including flexible working arrangements and opportunities for professional development, ensuring you can grow your skills while contributing to cutting-edge projects in the exciting field of data engineering and GenAI. Join our remote team in the UK and be part of a forward-thinking organisation that values your expertise and fosters a supportive environment for career advancement.
T

Contact Detail:

TECHNOLOGY AND RISK RECRUITMENT LTD Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Azure Data Engineer (Databricks + GenAI)

✨Tip Number 1

Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure and Databricks. Attend meetups or webinars to get your name out there and learn about potential job openings.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure Databricks and GenAI. This will give you an edge during interviews and help demonstrate your hands-on experience.

✨Tip Number 3

Prepare for technical interviews by brushing up on key concepts like lakehouse architecture and CI/CD practices. We recommend doing mock interviews with friends or using online platforms to get comfortable with the format.

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search!

We think you need these skills to ace Senior Azure Data Engineer (Databricks + GenAI)

Azure Databricks
PySpark
Delta Lake
Azure Data Factory
Synapse Pipelines
ADLS Gen2
Terraform
Bicep
Azure DevOps
GitHub Actions
Unity Catalog
Purview
Data Governance
Client Engagement
Mentorship

Some tips for your application 🫡

Tailor Your CV: Make sure your CV reflects the skills and experiences that match the Senior Azure Data Engineer role. Highlight your expertise in Azure Databricks, data engineering, and any relevant projects you've led. We want to see how you fit into our vision!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to tell us why you're passionate about data engineering and how your experience aligns with our needs. Be sure to mention your client engagement skills and any leadership roles you've taken on.

Showcase Your Projects: If you've worked on any impressive data engineering projects, don't hold back! Include links or descriptions of your work with Azure Databricks, CI/CD pipelines, or GenAI enablement. We love seeing real-world applications of your skills.

Apply Through Our Website: We encourage you to apply directly through our website for the best chance of getting noticed. It helps us keep track of your application and ensures you’re considered for the role. Plus, it’s super easy!

How to prepare for a job interview at TECHNOLOGY AND RISK RECRUITMENT LTD

✨Know Your Tech Inside Out

Make sure you’re well-versed in Azure Databricks, PySpark, and Delta Lake. Brush up on your knowledge of building end-to-end data pipelines and be ready to discuss specific projects where you've implemented these technologies.

✨Showcase Your Leadership Skills

As a Senior Azure Data Engineer, you'll need to demonstrate your ability to lead technical discussions and workshops. Prepare examples of how you've guided teams or mentored mid-level engineers in the past.

✨Prepare for Client Engagement Scenarios

Expect questions about translating business requirements into technical solutions. Think of instances where you've successfully engaged with clients and how you’ve navigated their needs into structured engineering delivery.

✨Understand Governance and Security

Familiarise yourself with Unity Catalog, Purview, and secure-by-design architecture principles. Be ready to discuss how you’ve implemented governance frameworks in previous roles and why they matter in data engineering.

Senior Azure Data Engineer (Databricks + GenAI)
TECHNOLOGY AND RISK RECRUITMENT LTD

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>