Senior Engineer, Data Engineering in Chesterfield

Join Our Team as a Data Engineer

Location: Chesterfield, Derbyshire

Are you an experienced Data Engineer with a strong background within Data Engineering, Design and Architecture looking for your next challenge? If so, we could have the perfect opportunity for you. This is a truly exciting time to join the Brightwell Data, Analytics and Insights team, at the beginning of a huge growth journey.

As a Data Engineer you will provide Brightwell Member Services with the data necessary to monitor operational performance, provide clients with transparent, automated, timely reporting and facilitate data led continuous improvement activities. Reporting into the Senior Insight & Analytics Manager, you will be responsible for understanding client strategic direction and interpreting this into a robust deliverable plan. The plan is to then be developed and implemented with input from internal stakeholders and integrate with ways of working, to meet organisational and client reporting needs. This will include designing appropriate data architecture and building and maintaining robust data pipelines, databases and automated data and reporting activities, to provide the data to influence clients and the Member Services leadership team.

You will leverage Azure Data Factory, Databricks and MS Fabric to create automated data and reporting solutions that provide colleagues and stakeholders with the data they need, when they need it. This role is critical for ensuring data integrity, scalability, and timely delivery of insights and will be an enabler for Brightwell to unlock the capabilities that come with the adoption of AI.

What you’ll do:

• Data Pipeline Development to facilitate Business Intelligence & Insight to provide extended reporting capabilities for internal stakeholders and clients.
• Design, implement, and optimise ETL/ELT pipelines using Azure Data Factory / Databricks / MS Fabric.
• Integrate data from multiple sources into a centralised data platform.
• Ensure pipelines are efficient, reliable, and scalable.
• Develop scripts and workflows for data cleansing and enrichment.
• Collaborate with analysts to ensure data models meet reporting requirements.
• Build, maintain, and optimise databases for performance and security to provide Brightwell a reliable, secure, and continually developed one version of the truth.
• Build, maintain, and optimise SQL databases for performance and security.
• Develop stored procedures, views, and indexing strategies that automate manual tasks.
• Monitor and troubleshoot database performance issues to provide a reliable product for stakeholders and clients.
• Create automated reporting extracts and dashboards that remove manual effort from the operation and provide clients with their data needs.
• Implement solutions for scheduled and on-demand data delivery to clients.
• Ensure compliance with data governance and security standards.
• Be collaborative & document by default to ensure robust data business continuity.
• Guide internal teams (Business Intelligence, Insight, Client Services, Operations) to document data requirements to deliver timely and accurate data solutions that enable Brightwell’s vision.
• Collaborate with IT and internal data owners to store, process and limit access to data to protect Brightwell’s reputation.
• Document data processes, architecture, and workflows for transparency and maintainability.
• Provide technical and colleague support in the context of data where necessary to increase the data literacy of the organisation.
• Enable an AI future by centralising Brightwell’s data.
• Guide the business to build the foundational data capabilities necessary for AI, challenging data silos and unnecessary complexity.
• Maximise the capabilities of Databricks, leveraging AI models securely within the Brightwell estate to create value, reduce customer effort and improve the employee experience.

This role would suit someone who:

Essential:

• Extensive experience with data modelling and relational database design within a similar role (usually equivalent to 5+ years’ experience).
• Highly proficient in SQL (query optimisation, stored procedures, indexing).
• Advanced hands-on experience with Azure Data Factory and Databricks.
• Solid understanding of ETL/ELT processes and data integration techniques.
• Familiarity with the end-to-end Azure ecosystem (Data Lake, Synapse, etc.).
• Proficient in Python for data engineering tasks.
• Deep understanding of data governance, security, and compliance best practices.
• Strong problem-solving and analytical skills.
• Excellent communication and stakeholder management.
• Ability to work independently and as part of a team.
• Detail-oriented with a focus on quality and accuracy.

Desirable:

• Degree in Computer Science, Data Engineering, or related field (or equivalent experience).
• Experience with Power BI or other visualisation tools.
• Exposure to CI/CD pipelines for data solutions.
• Understanding of cloud architecture and cost optimisation.
• Ability to work in Agile environments.
• Microsoft Azure certifications.

Why Brightwell?

As a Brightwell colleague, you will enjoy a competitive salary, hybrid work practices, professional development, career development, and a great benefits package including:

• Annual performance bonus.
• 25 days holiday (increasing to 30 with service) plus bank holidays.
• A pension with 15-17% employer contributions (depending on age).
• 8 x salary Life Insurance.
• Generous family friendly policies, including up to 26 weeks full pay (maternity, adoption and paternity leave).
• Free health assessments.
• Health cash plan.
• Professional study support.
• Employee Assistance Programme and free Wellhub wellness network platform access.
• Free parking.

Building an inclusive work environment:

Brightwell is committed to developing and maintaining an inclusive culture, ensuring that behaviours, working practices, and policies promote fair treatment and access to development opportunities for every colleague. We value the benefits a diverse workforce can bring and want Brightwell to be a place where all colleagues can thrive, feel that they belong, are valued, and contribute to our success. This is underpinned by Brightwell’s RISE corporate values: Responsible, Impactful, Supportive & Expert.