Data Engineer (Databricks) in Edinburgh

At M&G, our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, we have a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions.

Our two distinct operating segments, Asset Management and Life, work together to provide access to balanced, long-term investment and savings solutions. Through telling it like it is, owning it now and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent. We will consider flexible working arrangements for any of our roles and offer workplace adjustments to ensure you have the support you need to succeed in your role.

The Role:

A new solution for the validation and transformation of policyholder data used in actuarial modelling and assumption setting is being built. This role will build and maintain data pipelines to take policyholder data and transform and validate it for use in actuarial models. These data systems need to be robust, reliable, efficient, and meet actuarial modelling and assumption setting requirements. The Data Engineer supports the delivery of high-quality data solutions that underpin actuarial valuation and reporting, and strategic decision-making. Working collaboratively with stakeholders, the role ensures data is structured, governed, and transformed for actuarial use.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines that validate and transform data to meet actuarial modelling requirements.
• Implement checks and controls to ensure actuarial input data is complete, accurate, reconciled and available when required.
• Collaborate with stakeholders to understand data needs and translate them into effective technical solutions.
• Work with data suppliers to ensure data loads are complete and controlled.
• Work with suppliers and actuarial users to resolve data exceptions.
• Monitor and optimise data performance, resolving issues and improving efficiency where needed.
• Contribute to data governance, including documentation, standards, and controls.
• Maintain runbooks or support documentation.
• Work independently on well-defined deliverables and escalate material risks and issues appropriately.

Key Knowledge, Skills and Experience:

• Strong understanding of data structures, databases, and data modelling concepts.
• Experience working with data transformation, validation and storage processes.
• Ability to manage and process large datasets with attention to accuracy and quality.
• Familiarity with data governance and best practices in data management.
• Strong problem-solving skills and the ability to work collaboratively across teams.
• Experience working in Financial Services or a similar heavily audited environment with an understanding of operating controls and producing audit evidence.
• Clear communication with both technical and non-technical stakeholders.
• Proactive approach to identifying and resolving issues.
• Commitment to continuous improvement and delivering high-quality outcomes.

Essential Skills:

• Experience working on data pipelines.
• SQL.
• Data management and modelling.

Desirable Skills:

• Azure Databricks.
• Spark.
• Spark SQL.
• Python/PySpark.

What we offer:

We’re dedicated to supporting your wellbeing and helping you thrive, both at work and beyond. Our benefits are designed to help you balance your professional and personal life, and financially plan for the future.

Our UK benefits include:

• A valuable pension scheme of up to 18% (13% made up of employer contributions and 5% employee contributions).
• Access to our Share Save and Share Incentive Plan, alongside financial wellbeing and support services to help give you real confidence to put your money to work.
• Enjoy 38 days annual leave (including bank holidays), with the opportunity to purchase up to five extra days. Our Time Off When You Need It policy gives you the flexibility to balance work and personal commitments.
• Our market-leading Inspiring Families policy includes comprehensive support and paid parental leave covering maternity, adoption, surrogacy, and paternity leave - because supporting families is an important part of our inclusive culture.
• Health & Protection cover includes Private Healthcare, Critical Illness cover and Life Assurance for you, with additional family options - for peace of mind.

At M&G we strive to have a diverse workforce and an inclusive culture, underpinned by our policies and employee-led networks that offer networking, support and development opportunities for the diverse communities our colleagues represent. We welcome applications from people of all backgrounds – across gender, ethnicity, age, disability, sexual orientation and more – including neurodivergent individuals, career returners and those with military service experience. M&G is proud to be Level 3: Disability Confident Leader under the UK Government Disability Confident employer scheme, and we welcome applications from candidates with disabilities and long-term health conditions. If you would like to participate in the initiative, you will have the opportunity to indicate this on your application. We are committed to providing an inclusive recruitment process. All candidates have the opportunity to request reasonable adjustments when applying. If you need any additional support at any stage, please contact us.