At a Glance
- Tasks: Design and build scalable data pipelines using Databricks and Azure Synapse.
- Company: Join a forward-thinking company focused on data and analytics.
- Benefits: Enjoy competitive salary, flexible working, and opportunities for professional growth.
- Other info: Collaborative environment with mentorship opportunities and career advancement.
- Why this job: Make an impact in the data world while working with cutting-edge technology.
- Qualifications: Experience in data engineering and Azure platform administration required.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking a skilled and experienced Senior Data / Platform Engineer to join our Data & Analytics team. This hybrid role combines hands-on data engineering on Databricks and Azure Synapse with platform administration responsibilities across our cloud data estate. The role holder will design, build, and operate scalable data pipelines while also maintaining the underlying Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration.
Duties and Responsibilities
- Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
- Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources.
- Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs).
- Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform / Bicep).
- Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices.
- Administer Databricks workspaces — cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance.
- Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents.
- Implement robust data security and ensure compliance with data privacy regulations; manage service principals, Managed Identities, and least-privilege access.
- Carry out routine platform operations: patching, backups, storage lifecycle, tagging, access reviews, DR readiness, and runbook execution.
- Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
- Work with testers to ensure automated test plans are in place and agree test packs for UAT; review peers' work and take accountability for the quality of squad deliverables.
- Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, accessible data.
Qualification, Experience, Technical and Functional Skills
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field, with 6–10 years of relevant experience in data engineering and Azure platform administration.
Must Have
- Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows).
- Python / PySpark: strong programming skills for data processing, automation, and scripting.
- Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity, and Spark Pool configuration.
- Azure platform fundamentals: compute, storage, networking (VNets, NSGs, Private Endpoints), identity and RBAC.
- CI/CD: GitHub Actions (with OIDC federation) and/or Azure DevOps for data and platform deployments.
- Infrastructure-as-Code: Pulumi (or Terraform / Bicep) across multiple environments.
- Scripting: PowerShell and Bash for platform automation.
- Monitoring & observability: Azure Monitor, Log Analytics, KQL.
- Big data file formats: Parquet and Delta Lake.
- Cloud-native data modelling and ETL/ELT frameworks on Azure.
Azure Data Engineer in Guildford employer: Ampstek
Join our dynamic Data & Analytics team as an Azure Data Engineer, where you'll thrive in a collaborative and innovative work culture that prioritises employee growth and development. With a focus on cutting-edge technology and a commitment to data security and compliance, we offer a hybrid working environment that fosters flexibility and work-life balance, making it an excellent place for professionals seeking meaningful and rewarding employment.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Data Engineer in Guildford
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks and Azure. This gives potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering questions and scenarios. Practice explaining your thought process when designing scalable data pipelines.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive!
We think you need these skills to ace Azure Data Engineer in Guildford
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Azure Data Engineer role. Highlight your experience with Databricks, Azure Synapse, and any relevant projects you've worked on. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific examples of data pipelines you've built or optimised. If you've used infrastructure-as-code tools like Pulumi or Terraform, let us know! We love seeing real-world applications of your skills.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for your achievements and responsibilities. We appreciate a well-structured application that makes it easy for us to see your qualifications.
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!
How to prepare for a job interview at Ampstek
✨Know Your Tech Stack Inside Out
Make sure you’re well-versed in the Azure data stack, especially Databricks and Azure Synapse. Brush up on your knowledge of ETL/ELT processes and be ready to discuss how you've built and optimised data pipelines in the past.
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of how you've identified and resolved performance bottlenecks or data quality issues. This will demonstrate your analytical thinking and ability to ensure data accuracy and reliability.
✨Familiarise Yourself with Infrastructure-as-Code
Since the role involves managing infrastructure-as-code using Pulumi (or similar tools), be ready to discuss your experience with it. Highlight any projects where you’ve implemented CI/CD pipelines and how you’ve automated deployments.
✨Engage with Stakeholders
Be prepared to talk about how you’ve collaborated with stakeholders to understand data requirements. Show that you can communicate effectively and deliver clean, reliable data that meets their needs.
