At a Glance
- Tasks: Design and build scalable data pipelines using Azure and Databricks while managing cloud infrastructure.
- Company: Join a forward-thinking company focused on data innovation and analytics.
- Benefits: Enjoy competitive pay, flexible working options, and opportunities for professional growth.
- Other info: Dynamic role with excellent career advancement potential in a supportive environment.
- Why this job: Make an impact in the data world with cutting-edge technology and collaborative teamwork.
- Qualifications: Experience in data engineering and Azure platform management is essential.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking a skilled and experienced Senior Data / Platform Engineer to join our Data & Analytics team. This hybrid role combines hands-on data engineering on Databricks and Azure Synapse with platform administration responsibilities across our cloud data estate. The role holder will design, build, and operate scalable data pipelines while also maintaining the underlying Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration.
Duties and Responsibilities
- Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
- Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources.
- Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs).
- Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform / Bicep).
- Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices.
- Administer Databricks workspaces — cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance.
- Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents.
- Implement robust data security and ensure compliance with data privacy regulations; manage service principals, Managed Identities, and least-privilege access.
- Carry out routine platform operations: patching, backups, storage lifecycle, tagging, access reviews, DR readiness, and runbook execution.
- Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
- Work with testers to ensure automated test plans are in place and agree test packs for UAT; review peers' work and take accountability for the quality of squad deliverables.
- Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, accessible data.
Qualification, Experience, Technical and Functional Skills
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field, with 6–10 years of relevant experience in data engineering and Azure platform administration.
Must Have
- Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows).
- Python / PySpark: strong programming skills for data processing, automation, and scripting.
- Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity, and Spark Pool configuration.
- Azure platform fundamentals: compute, storage, networking (VNets, NSGs, Private Endpoints), identity and RBAC.
- CI/CD: GitHub Actions (with OIDC federation) and/or Azure DevOps for data and platform deployments.
- Infrastructure-as-Code: Pulumi (or Terraform / Bicep) across multiple environments.
- Scripting: PowerShell and Bash for platform automation.
- Monitoring & observability: Azure Monitor, Log Analytics, KQL.
- Big data file formats: Parquet and Delta Lake.
- Cloud-native data modelling and ETL/ELT frameworks on Azure.
Azure Data Engineer in Woking employer: Ampstek
Join a forward-thinking company that values innovation and collaboration, where as an Azure Data Engineer, you will have the opportunity to work with cutting-edge technologies in a hybrid environment. Our supportive work culture fosters professional growth through mentorship and continuous learning, while our commitment to data security and compliance ensures a meaningful impact on our clients' success. Enjoy competitive benefits and a dynamic team atmosphere in a location that promotes work-life balance and community engagement.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Data Engineer in Woking
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering space, especially those who work with Azure. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks and Azure Synapse. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges with ETL/ELT pipelines or managed Azure components. We want to see your problem-solving skills in action!
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Azure Data Engineer in Woking
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Azure Data Engineer role. Highlight your experience with Databricks, Azure Synapse, and any relevant projects you've worked on. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific examples of data pipelines you've built or optimised. If you've used infrastructure-as-code tools like Pulumi or Terraform, let us know! We love seeing real-world applications of your skills.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for your achievements and responsibilities. We appreciate a well-structured application that makes it easy for us to see your qualifications.
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!
How to prepare for a job interview at Ampstek
✨Know Your Tech Stack
Make sure you’re well-versed in the Azure data stack, especially Databricks and Azure Synapse. Brush up on your knowledge of ETL/ELT processes and be ready to discuss how you've built and optimised data pipelines in the past.
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of how you've identified and resolved performance bottlenecks or data quality issues. Use the STAR method (Situation, Task, Action, Result) to structure your answers and demonstrate your analytical thinking.
✨Familiarise Yourself with Infrastructure-as-Code
Since this role involves managing infrastructure-as-code using Pulumi or similar tools, be ready to discuss your experience with these technologies. Highlight any projects where you’ve implemented CI/CD pipelines and how you ensured smooth deployments.
✨Understand Data Security and Compliance
Data security is crucial, so brush up on your knowledge of compliance regulations and best practices. Be prepared to discuss how you've managed access control and ensured data privacy in your previous roles.