Senior Data Engineer in City of Westminster

About the role

Our Senior Data Engineers empower public sector organisations to adopt data‑driven strategies by delivering high‑quality, cost‑efficient data platforms and services tailored to client needs.

They develop, operate and maintain these services, ensuring maximum value for analysts, scientists and business stakeholders.

Responsibilities

• Act as a senior contributor on projects, delivering engineering work and upskilling client team members.
• Operate as a technical architect when required, collaborating with the Made Tech team to identify growth opportunities.
• Plan and execute data pipelines on cloud environments, integrating robust error handling and reusable libraries.
• Deploy and manage cloud infrastructure using Ia C, maintaining Dev Ops practices and ensuring resilience.
• Document and present end‑to‑end system diagrams using C4, UML or similar.
• Guide Data Ops implementation, covering orchestration, data integration and analytics tooling.
• Apply security reviews, vulnerability checks and testing strategies (unit, integration, data quality).
• Use Agile practices (Scrum, XP, Kanban) and mentor team members, providing line‑management duties where required.
• Demonstrate commercial awareness to grow accounts with senior stakeholders.

Qualifications

• Proficient in Git (including Git Hub Actions) and knowledgeable about branch strategies.
• Experience with Ia C and deploying infrastructure across environments.
• Hands‑on with Apache Spark, Databricks or Hadoop; ability to transform JSON, CSV, and other data types.
• Understanding of modern data architectures: data warehouses, lakes and meshes, plus use‑case differentiation.
• Knowledge of SOLID, DRY, TDD principles and how to implement them.
• Familiarity with Agile methodologies (Scrum, XP, Kanban).
• Strong communication skills; able to present system diagrams and guide teams.
• Eligibility for a security clearance (SC) – five years of continuous UK residency.

Desirable Experience

• Technology consultancy background.
• Working with Docker, virtual environments and CI/CD pipelines.
• Experience with pair or mob programming.
• Collaboration with data scientists on productionising machine‑learning models.
• Working knowledge of statistics.
• Experience in multidisciplinary digital and technology teams.
• Previous work in the public sector.

Benefits

• 30 days of paid annual leave plus bank holidays.
• Flexible parental leave options.
• Option for part‑time remote working.
• Paid counselling and access to financial and legal advice.
• Flexible benefit platform including a Smart Tech scheme, Cycle‑to‑work scheme and an individual benefits allowance for health‑care cash or pension plans.
• Access to social and wellbeing calendar events.
• Equal Opportunity

We are committed to building a happy, inclusive and diverse workforce.

All qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, sexual orientation, age, disability or any other protected characteristic.

#J-18808-Ljbffr