Senior Data Engineer - Python & Azure (Permanent) in England

Senior Data Engineer - Python & Azure (Permanent) in England

England Full-Time 70000 - 90000 € / year (est.) Home office possible
T

At a Glance

  • Tasks: Lead data engineering projects using Azure Databricks and GenAI technologies.
  • Company: Join a forward-thinking tech company focused on innovation and collaboration.
  • Benefits: Enjoy a competitive salary, remote work flexibility, and opportunities for professional growth.
  • Other info: Dynamic role with mentorship opportunities and a focus on best practices.
  • Why this job: Make an impact by building cutting-edge data platforms that drive analytics and AI applications.
  • Qualifications: 8+ years in data engineering with strong Azure and Python skills.

The predicted salary is between 70000 - 90000 € per year.

We are seeking a Senior Azure Data Engineer to take ownership of the data engineering capability across multiple enterprise-scale Azure Databricks programmes. This role sits at the intersection of data engineering, cloud architecture, and GenAI enablement, building production-grade lakehouse platforms that power analytics, automation, and AI-driven applications. You will act as a technical lead and client-facing engineer, responsible for designing, delivering, and governing scalable Azure + Databricks data platforms.

Key Responsibilities:

  • Architecture Leadership
    • Define Azure Databricks lakehouse architectures (medallion model)
    • Review and approve engineering designs across projects
  • Data Engineering Delivery
    • Build end-to-end pipelines using: Azure Databricks (PySpark, Delta Lake, Workflows), Azure Data Factory / Synapse Pipelines, ADLS Gen2
    • Deliver curated data products (bronze / silver / gold)
  • GenAI Enablement
    • Prepare data for RAG and AI workloads
    • Work with Azure OpenAI + Azure AI Search
    • Implement embedding, chunking, and retrieval strategies
  • CI/CD & Infrastructure
    • Implement IaC using Terraform or Bicep
    • Manage CI/CD pipelines using Azure DevOps or GitHub Actions
    • Use Databricks Asset Bundles for deployment automation
  • Governance & Security
    • Implement Unity Catalog, Purview, RBAC, and data lineage
    • Ensure secure-by-design architecture (Key Vault, Entra ID)
  • Client Engagement
    • Lead workshops, design sessions, and technical discussions
    • Translate business requirements into structured engineering delivery
  • Mentorship
    • Guide and support mid-level engineers
    • Enforce engineering standards and best practices

Required Experience:

  • 8+ years in data engineering
  • 4+ years hands-on Azure data platform experience
  • Expert-level Azure Databricks (PySpark, Delta Lake, Jobs, tuning)
  • Strong Azure Data Factory / ADLS Gen2 / Azure SQL experience
  • Solid Python and SQL engineering background
  • Experience with lakehouse / medallion architecture
  • CI/CD & IaC (Terraform or Bicep + Azure DevOps/GitHub Actions)
  • Understanding of Azure AI Search / Azure OpenAI / RAG concepts
  • Experience with Unity Catalog / Purview / data governance frameworks

Soft Skills:

  • Strong client-facing communication skills
  • Confident leading technical design discussions
  • Ability to manage ambiguity and define structure
  • Mentoring and leadership capability

Nice to Have:

  • Power BI / Fabric experience
  • Salesforce data integration experience
  • Microsoft certifications (DP-203, DP-700, AZ-305, etc.)
  • Experience in real-time or operational data environments
  • Exposure to Data/AI Centre of Excellence environments

Senior Data Engineer - Python & Azure (Permanent) in England employer: Technology & Risk Recruitment

Join a forward-thinking company that values innovation and collaboration, offering a dynamic work culture where your expertise as a Senior Azure Data Engineer will be recognised and rewarded. With a focus on employee growth, we provide ample opportunities for professional development and mentorship, ensuring you thrive in your career while working remotely from the UK. Enjoy the unique advantage of contributing to cutting-edge projects in data engineering and GenAI, all within a supportive environment that champions creativity and technical excellence.

T

Contact Detail:

Technology & Risk Recruitment Recruiting Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Data Engineer - Python & Azure (Permanent) in England

Tip Number 1

Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure and Databricks. Attend meetups or webinars to meet potential employers and get your name out there.

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure Data Factory and Databricks. This will give you an edge when discussing your experience during interviews.

Tip Number 3

Prepare for technical interviews by brushing up on your Python and SQL skills. Be ready to discuss your experience with CI/CD pipelines and IaC tools like Terraform. Practice common data engineering scenarios to impress your interviewers.

Tip Number 4

Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Plus, it’s a great way to ensure your application gets the attention it deserves.

We think you need these skills to ace Senior Data Engineer - Python & Azure (Permanent) in England

Azure Databricks
PySpark
Delta Lake
Azure Data Factory
ADLS Gen2
CI/CD
Infrastructure as Code (IaC)

Some tips for your application 🫡

Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Senior Azure Data Engineer role. Highlight your expertise in Azure Databricks, Python, and any relevant projects you've led. We want to see how you can bring value to our team!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to tell us why you're passionate about data engineering and how your experience aligns with our mission at StudySmarter. Be sure to mention specific projects or achievements that showcase your skills.

Showcase Your Technical Skills:In your application, don't shy away from detailing your technical prowess. Mention your experience with CI/CD, IaC, and any tools like Terraform or Azure DevOps. We love seeing candidates who are hands-on and ready to tackle challenges head-on!

Apply Through Our Website:We encourage you to apply directly through our website for a smoother process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, we love seeing applications come in through our own platform!

How to prepare for a job interview at Technology & Risk Recruitment

Know Your Tech Inside Out

Make sure you’re well-versed in Azure Databricks, PySpark, and the medallion architecture. Brush up on your knowledge of data pipelines and how to build them using Azure Data Factory. Being able to discuss specific projects where you've implemented these technologies will really impress.

Showcase Your Leadership Skills

As a Senior Data Engineer, you'll be expected to lead workshops and technical discussions. Prepare examples of how you've guided teams or mentored mid-level engineers in the past. Highlight your ability to translate complex technical concepts into understandable terms for clients.

Prepare for Client Engagement Scenarios

Expect questions about how you would handle client interactions. Think of scenarios where you’ve successfully managed client expectations or led design sessions. Demonstrating strong communication skills and confidence in these situations will set you apart.

Understand Governance and Security

Familiarise yourself with Unity Catalog, Purview, and secure-by-design principles. Be ready to discuss how you’ve implemented governance frameworks in previous roles. Showing that you prioritise security in your designs will resonate well with interviewers.