Senior Data Engineer (MLOps Engineer) in London

As a Senior Data Engineer, you will play a key role in building and maintaining production‑ready data and machine‑learning systems that support critical business decisions. You’ll work across the full lifecycle, from engaging with stakeholders and shaping data/model outputs, to deploying and maintaining real‑time services in a cloud environment.

A significant part of this role involves developing and evolving our cloud‑based infrastructure, including containerised applications, automated deployment pipelines, and infrastructure‑as‑code. You’ll also help shape engineering best practices and support the growth of modern, scalable data platforms.

You’ll join one of our small stream‑aligned agile teams, working closely with domain experts to understand business needs and deliver high‑impact solutions. Teams rotate gradually to broaden your exposure to new data challenges and technical domains.

Location: This role is hybrid, with the option to work from our London, Bristol, or Bournemouth offices. You’ll be required to attend the office two days per month.

Salary Information: Pay: Circa £60,000 per annum, dependent on experience, skills, and location. Salary is one part of our wider total reward package.

What You’ll Do:

• Design, build, and operate production‑level data and machine‑learning services, including real‑time API endpoints that serve 10 million + requests daily.
• Build and deploy and orchestrate docker containers, optimizing for performance and resource utilization.
• Design, build and maintain cloud R&D solutions using IaC tools like Terraform.
• Building, improving and maintaining monitoring systems to track model performance, infrastructure health and ensure reliability, scalability, and security of ML systems.
• Develop CICD processes to help automate workflows using tools like Azure DevOps.
• Write high‑quality, well‑tested Python for production‑grade data pipelines and services.
• Deliver data extracts, transformations, and features to support modelling and analytics.
• Work within an agile workflow, managing your own tickets and collaborating with team members and across disciplines to deliver products.
• Communicate technical decisions and findings to both technical and non‑technical audiences.
• Taking time to stay up to date with the newest cloud and data tech as you contribute to continuous improvement across cloud tooling, engineering standards, and platform development.

About You (What We’re Looking For):

Essential Skills:

• Experience deploying, monitoring and maintaining production services. We’re looking for engineers who have worked hands‑on with:
• Containerisation (Docker) & Service orchestration (Kubernetes or similar).
• Managing and maintaining real‑time endpoints or APIs.
• Automated deployment into production environments.
• Cloud & Infrastructure Engineering. Experience building or supporting cloud infrastructure for data or predictive services, ideally including:
• Terraform (highly desirable).
• Azure (preferred), or other public cloud platforms.
• Infrastructure patterns for scalable, secure services.
• CI/CD Automation. Experience with:
• Azure DevOps or GitHub Actions.
• Automated testing, packaging, and deployment processes.
• Data Engineering Experience. We are not looking for profiles focused only on ETL. However, we will consider candidates who bring Cloud + CI/CD experience alongside technologies such as:
• Proficient SQL; familiarity with PySpark is beneficial.
• dbt.
• Microsoft Fabric.
• SQLMesh.
• Core Engineering Skills:
• Strong Python, with good documentation and unit testing practices.
• Comfortable in an agile delivery environment.
• Able to communicate clearly with non‑technical teams.
• Demonstrates curiosity, continuous learning, and a collaborative mindset.

Desirable Skills:

• Understanding of GDPR and data governance.
• Experience in insurance or financial services.
• Familiarity with LLMs (e.g., GPT, OpenAI).
• Knowledge of infrastructure monitoring, backup, or disaster recovery.

What We Will Offer You:

• Flexible buy/sell holiday options.
• Hybrid working.
• Annual performance related bonus.
• Contributory pension scheme.
• Development days.
• A discount up to 50% on a range of insurance products including car, home and pet.
• Retail discounts.
• Volunteering days.

Integrity, Fairness, Inclusion & Trust: At Allianz, we believe in fostering an inclusive workforce and are proud to be an equal opportunity employer. Our commitment to equal opportunities, gender equity, and balanced gender representation, is demonstrated by our numerous accreditations: EDGE certified for gender inclusion, Women in Finance Charter members, Disability Confident employer, Stonewall Diversity Champion, Business in the Community’s Race at Work Charter signatories, and Armed Forces Covenant gold standard employer. We embrace neurodiversity and welcome applications from neurodivergent and disabled candidates, offering tailored adjustments to ensure your success. We encourage our employees to advocate for their needs, whether it’s assistive technology, ergonomic equipment, mentoring, coaching, or flexible work arrangements.