At a Glance
- Tasks: Design and build scalable data pipelines using Azure and Databricks.
- Company: Join a forward-thinking company focused on data innovation.
- Benefits: Flexible working, competitive salary, and opportunities for professional growth.
- Other info: Collaborative team environment with mentorship opportunities.
- Why this job: Make an impact in the data world while developing your skills.
- Qualifications: Experience with Azure, Databricks, and strong programming skills in Python.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking a skilled and experienced Senior Data / Platform Engineer to join our Data & Analytics team. This hybrid role combines hands-on data engineering on Databricks and Azure Synapse with platform administration responsibilities across our cloud data estate. The role holder will design, build, and operate scalable data pipelines while also maintaining the underlying Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration.
Duties and Responsibilities
- Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
- Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources.
- Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs).
- Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform / Bicep).
- Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices.
- Administer Databricks workspaces — cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance.
- Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents.
- Implement robust data security and ensure compliance with data privacy regulations; manage service principals, Managed Identities, and least-privilege access.
- Carry out routine platform operations: patching, backups, storage lifecycle, tagging, access reviews, DR readiness, and runbook execution.
- Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
- Work with testers to ensure automated test plans are in place and agree test packs for UAT; review peers' work and take accountability for the quality of squad deliverables.
- Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, accessible data.
Qualification, Experience, Technical and Functional Skills
Bachelor's or Master's degree in Computer Science, Information Systems, or a related field, with 6–10 years of relevant experience in data engineering and Azure platform administration.
Must Have
- Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows).
- Python / PySpark: strong programming skills for data processing, automation, and scripting.
- Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity, and Spark Pool configuration.
- Azure platform fundamentals: compute, storage, networking (VNets, NSGs, Private Endpoints), identity and RBAC.
- CI/CD: GitHub Actions (with OIDC federation) and/or Azure DevOps for data and platform deployments.
- Infrastructure-as-Code: Pulumi (or Terraform / Bicep) across multiple environments.
- Scripting: PowerShell and Bash for platform automation.
- Monitoring & observability: Azure Monitor, Log Analytics, KQL.
- Big data file formats: Parquet and Delta Lake.
- Cloud-native data modelling and ETL/ELT frameworks on Azure.
Azure Data Engineer employer: Ampstek
Join a forward-thinking company that values innovation and collaboration, where as an Azure Data Engineer, you will have the opportunity to work with cutting-edge technologies in a hybrid environment. Our supportive work culture encourages professional growth through mentorship and continuous learning, while our commitment to data security and compliance ensures you are part of a responsible and impactful team. Located in a vibrant area, we offer flexible working arrangements and a focus on work-life balance, making us an excellent employer for those seeking meaningful and rewarding careers.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Data Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering questions and scenarios. Practice explaining your past projects and how you've tackled challenges, especially around CI/CD and infrastructure-as-code.
✨Tip Number 4
Don't forget to apply through our website! We love seeing applications come directly from candidates who are excited about joining our team. Plus, it shows you're genuinely interested in working with us.
We think you need these skills to ace Azure Data Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Azure Data Engineer role. Highlight your experience with Databricks, Azure Synapse, and any relevant projects you've worked on. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific examples of data pipelines you've built or optimised. If you've used infrastructure-as-code tools like Pulumi or Terraform, let us know! We love seeing real-world applications of your skills.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for your achievements and responsibilities to make it easy for us to read. We appreciate a well-structured application!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at Ampstek
✨Know Your Tech Stack
Make sure you’re well-versed in the Azure data stack, especially Databricks and Azure Synapse. Brush up on your knowledge of Delta Lake, ADLS Gen2, and Key Vault, as these are crucial for the role. Being able to discuss your hands-on experience with these tools will show that you're ready to hit the ground running.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in previous roles, particularly around data pipeline optimisation or platform administration. Use the STAR method (Situation, Task, Action, Result) to structure your answers, highlighting how you identified performance bottlenecks and resolved data quality issues.
✨Demonstrate Collaboration and Mentorship
This role involves leading solution design activities and mentoring junior colleagues. Be ready to share examples of how you've collaborated with peers or guided less experienced team members. This will illustrate your leadership potential and ability to work within a team.
✨Understand CI/CD and Infrastructure-as-Code
Familiarise yourself with CI/CD practices using GitHub Actions or Azure DevOps, and be prepared to discuss your experience with infrastructure-as-code tools like Pulumi or Terraform. Highlight any projects where you’ve implemented these practices, as they are key components of the job.
