At a Glance
- Tasks: Lead data engineering projects using Azure Databricks and GenAI technologies.
- Company: Join a forward-thinking tech company focused on innovation and collaboration.
- Benefits: Enjoy competitive salary, remote work flexibility, and opportunities for professional growth.
- Other info: Dynamic role with mentorship opportunities and a focus on best practices.
- Why this job: Make an impact by building cutting-edge data platforms that drive analytics and AI applications.
- Qualifications: 8+ years in data engineering with strong Azure and Python skills.
The predicted salary is between 70000 - 90000 β¬ per year.
We are seeking a Senior Azure Data Engineer to take ownership of the data engineering capability across multiple enterprise-scale Azure Databricks programmes. This role sits at the intersection of data engineering, cloud architecture, and GenAI enablement, building production-grade lakehouse platforms that power analytics, automation, and AI-driven applications. You will act as a technical lead and client-facing engineer, responsible for designing, delivering, and governing scalable Azure + Databricks data platforms.
Key Responsibilities:
- Architecture Leadership
- Define Azure Databricks lakehouse architectures (medallion model)
- Review and approve engineering designs across projects
- Data Engineering Delivery
- Build end-to-end pipelines using: Azure Databricks (PySpark, Delta Lake, Workflows), Azure Data Factory / Synapse Pipelines, ADLS Gen2
- Deliver curated data products (bronze / silver / gold)
- GenAI Enablement
- Prepare data for RAG and AI workloads
- Work with Azure OpenAI + Azure AI Search
- Implement embedding, chunking, and retrieval strategies
- CI/CD & Infrastructure
- Implement IaC using Terraform or Bicep
- Manage CI/CD pipelines using Azure DevOps or GitHub Actions
- Use Databricks Asset Bundles for deployment automation
- Governance & Security
- Implement Unity Catalog, Purview, RBAC, and data lineage
- Ensure secure-by-design architecture (Key Vault, Entra ID)
- Client Engagement
- Lead workshops, design sessions, and technical discussions
- Translate business requirements into structured engineering delivery
- Mentorship
- Guide and support mid-level engineers
- Enforce engineering standards and best practices
Required Experience:
- 8+ years in data engineering
- 4+ years hands-on Azure data platform experience
- Expert-level Azure Databricks (PySpark, Delta Lake, Jobs, tuning)
- Strong Azure Data Factory / ADLS Gen2 / Azure SQL experience
- Solid Python and SQL engineering background
- Experience with lakehouse / medallion architecture
- CI/CD & IaC (Terraform or Bicep + Azure DevOps/GitHub Actions)
- Understanding of Azure AI Search / Azure OpenAI / RAG concepts
- Experience with Unity Catalog / Purview / data governance frameworks
Soft Skills:
- Strong client-facing communication skills
- Confident leading technical design discussions
- Ability to manage ambiguity and define structure
- Mentoring and leadership capability
Nice to Have:
- Power BI / Fabric experience
- Salesforce data integration experience
- Microsoft certifications (DP-203, DP-700, AZ-305, etc.)
- Experience in real-time or operational data environments
- Exposure to Data/AI Centre of Excellence environments
Senior Data Engineer (Python/Azure) in England employer: Technology & Risk Recruitment
As a Senior Data Engineer at our company, you will thrive in a dynamic and inclusive work culture that prioritises innovation and collaboration. We offer competitive benefits, including flexible working arrangements and opportunities for professional development, ensuring you can grow your skills while contributing to cutting-edge projects in the exciting field of Azure Databricks and GenAI. Join us in a remote role that empowers you to lead impactful data engineering initiatives from anywhere in the UK, making a meaningful difference in the world of analytics and AI.
Contact Detail:
Technology & Risk Recruitment Recruiting Team
StudySmarter Expert Adviceπ€«
We think this is how you could land Senior Data Engineer (Python/Azure) in England
β¨Network Like a Pro
Get out there and connect with folks in the industry! Attend meetups, webinars, or even local tech events. The more people you know, the better your chances of landing that Senior Data Engineer role.
β¨Show Off Your Skills
Donβt just talk about your experience; demonstrate it! Create a portfolio showcasing your projects, especially those involving Azure Databricks and GenAI. This will give potential employers a taste of what you can do.
β¨Ace the Interview
Prepare for technical interviews by brushing up on your Azure and Python skills. Practice common data engineering scenarios and be ready to discuss your past projects in detail. Confidence is key!
β¨Apply Through Us
Check out our website for the latest job openings. Applying directly through us not only shows your interest but also gives you a better chance of getting noticed by our hiring team!
We think you need these skills to ace Senior Data Engineer (Python/Azure) in England
Some tips for your application π«‘
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Senior Azure Data Engineer role. Highlight your expertise in Azure Databricks, Python, and any relevant projects you've led. We want to see how you fit into our vision!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to tell us why you're passionate about data engineering and how your experience aligns with our needs. Be sure to mention specific projects or achievements that showcase your skills.
Showcase Your Technical Skills:In your application, don't shy away from detailing your technical prowess. Mention your experience with CI/CD, IaC, and any tools like Terraform or Azure DevOps. We love seeing candidates who can hit the ground running!
Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It helps us keep track of applications and ensures youβre considered for the role. Plus, itβs super easy!
How to prepare for a job interview at Technology & Risk Recruitment
β¨Know Your Tech Inside Out
Make sure youβre well-versed in Azure Databricks, PySpark, and the medallion architecture. Brush up on your knowledge of data pipelines and how to build them using Azure Data Factory. Being able to discuss specific projects where you've implemented these technologies will really impress.
β¨Showcase Your Leadership Skills
As a Senior Data Engineer, you'll be expected to lead workshops and technical discussions. Prepare examples of how you've guided teams or mentored mid-level engineers in the past. Highlight your ability to translate complex technical concepts into understandable terms for clients.
β¨Prepare for Client Engagement Scenarios
Since this role involves client-facing responsibilities, practice how you would handle technical discussions with clients. Think about how you can effectively communicate engineering solutions that meet business needs. Role-playing these scenarios with a friend can help you feel more confident.
β¨Understand Governance and Security
Familiarise yourself with Unity Catalog, Purview, and RBAC. Be ready to discuss how you ensure secure-by-design architectures in your previous roles. This shows that you not only understand the technical side but also the importance of governance in data engineering.