At a Glance
- Tasks: Design and build scalable data pipelines while managing Azure platform components.
- Company: Join a leading company in the data and analytics space.
- Benefits: Enjoy a competitive salary, flexible remote work, and opportunities for professional growth.
- Other info: Collaborative culture with mentorship opportunities and a focus on continuous improvement.
- Why this job: Make an impact by working with cutting-edge technologies in a dynamic environment.
- Qualifications: 6-10 years of experience in data engineering and strong Azure platform skills required.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking a skilled and experienced Senior Data / Platform Engineer to join our Data & Analytics team. This hybrid role combines hands-on data engineering on Databricks and Azure Synapse with platform administration responsibilities across our cloud data estate. The role holder will design, build, and operate scalable data pipelines while also maintaining the underlying Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration. The ideal candidate combines strong Python/PySpark engineering skills with deep Azure platform knowledge and a service-excellence mindset, ensuring the Allianz Data Technology platform remains secure, reliable, and aligned to Allianz standards.
Duties and Responsibilities
- Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
- Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources.
- Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs).
- Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform / Bicep).
- Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices.
- Administer Databricks workspaces — cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance.
- Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents.
- Implement robust data security and ensure compliance with data privacy regulations; manage service principals, Managed Identities, and least-privilege access.
- Carry out routine platform operations: patching, backups, storage lifecycle, tagging, access reviews, DR readiness, and runbook execution.
- Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
- Work with testers to ensure automated test plans are in place and agree test packs for UAT; review peers' work and take accountability for the quality of squad deliverables.
- Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, accessible data.
- Ensure solution designs align with the Allianz Data Technology Strategy, maintaining and enhancing Allianz standards and Service Excellence.
- Maintain technical documentation to Allianz standards (e.g., Grimlock) and stay current with industry trends, driving continuous improvement and innovation.
Qualification, Experience, Technical and Functional Skills
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field, with 6–10 years of relevant experience in data engineering and Azure platform administration.
Must Have
- Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows).
- Python / PySpark: strong programming skills for data processing, automation, and scripting.
- Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity, and Spark Pool configuration.
- Azure platform fundamentals: compute, storage, networking (VNets, NSGs, Private Endpoints), identity and RBAC.
- CI/CD: GitHub Actions (with OIDC federation) and/or Azure DevOps for data and platform deployments.
- Infrastructure-as-Code: Pulumi (or Terraform / Bicep) across multiple environments.
- Scripting: PowerShell and Bash for platform automation.
- Monitoring & observability: Azure Monitor, Log Analytics, KQL.
- Big data file formats: Parquet and Delta Lake.
- Cloud-native data modelling and ETL/ELT frameworks on Azure.
Good to Have
- Azure certifications: AZ-104, AZ-400, DP-203.
- Azure Data Factory (ADF), Microsoft Purview, Microsoft Fabric.
- Data governance: lineage, cataloguing, sensitivity labels.
- Event-driven architectures: Kafka / Azure Event Hubs.
- Delta Live Tables, MLflow.
- IDMC Secure Agent, Power Automate flows.
- Security baselines: CIS / NIST.
- Observability tooling: OpenTelemetry, Datadog.
- AI tools and their application in data engineering.
- Knowledge of the UK Insurance Market.
- Agile / Scrum delivery experience.
Senior Data Platform Engineer in Guildford employer: Ampstek
At Allianz, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation. As a Senior Data Platform Engineer in Guilford, you will enjoy the flexibility of mostly remote work while having access to continuous professional development opportunities and a supportive team environment. Our commitment to service excellence and employee growth ensures that you will thrive in your role, contributing to impactful projects within a leading global organisation.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Data Platform Engineer in Guildford
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks and Azure. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by practising common questions related to data engineering and Azure platform administration. We recommend doing mock interviews with friends or using online platforms to boost your confidence.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are genuinely interested in joining our team.
We think you need these skills to ace Senior Data Platform Engineer in Guildford
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Senior Data Platform Engineer role. Highlight your experience with Databricks, Azure, and Python/PySpark. We want to see how your skills align with what we're looking for!
Showcase Your Projects:Include specific projects where you've designed and built data pipelines or managed Azure platforms. We love seeing real examples of your work that demonstrate your expertise and problem-solving skills.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for easy reading and make sure to highlight your key achievements. We appreciate straightforward communication!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at Ampstek
✨Know Your Tech Stack Inside Out
Make sure you’re well-versed in the technologies mentioned in the job description, especially Databricks and Azure Synapse. Brush up on your Python and PySpark skills, as you'll likely be asked to demonstrate your understanding of building and optimising data pipelines.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in previous roles, particularly around data quality issues or performance bottlenecks. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight how you resolved these issues effectively.
✨Demonstrate Your Collaboration Skills
Since this role involves mentoring junior colleagues and collaborating with stakeholders, be ready to share examples of how you've worked in teams. Discuss how you’ve led solution design activities and ensured alignment with broader strategies, showcasing your service-excellence mindset.
✨Ask Insightful Questions
Prepare thoughtful questions about the team dynamics, current projects, and the company’s approach to data security and compliance. This not only shows your interest in the role but also helps you gauge if the company culture aligns with your values.
