Senior Data Engineer

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients’ needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer, you may assume multiple roles based on our clients\’ needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You’ll need a drive to deliver outcomes for users, considering the broader context of delivery and maintaining alignment between operational and analytical aspects of the engineering solution. Skills, knowledge and expertise We seek candidates with a range of skills and experience; please apply even if you don’t meet all criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON, CSV, etc.) using Apache Spark, Databricks, or Hadoop Understanding modern data system architectures (Data Warehouse, Data Lakes, Data Meshes) and their use cases Creating data pipelines on cloud platforms with error handling and reusable libraries Documenting and presenting end-to-end data processing system diagrams (C4, UML, etc.) Implementing robust DevOps practices in data projects, including DataOps tools for orchestration, data integration, and analytics Enhancing resilience through vulnerability checks and testing strategies (unit, integration, data quality) Applying SOLID, DRY, and TDD principles practically Agile methodologies such as Scrum, XP, and Kanban Designing and implementing efficient batch and streaming data transformations at scale Mentoring, team support, and line management skills Commercial mindset to grow accounts organically with senior stakeholders Experience in the following areas is desirable but not essential: Working in a technology consultancy Using Docker and virtual environments in CI/CD Engaging with senior stakeholders for requirements gathering Collaborating with engineers via pair or mob programming Working with data scientists to productionize machine learning models Knowledge of statistics Collaborating across multidisciplinary teams Experience within the public sector Support in applying If you need this job description in another format or require support in applying, please email talent@madetech.com. We believe technology can improve public services and that diversity within our team enhances this mission. We encourage applicants from underrepresented groups to apply. We are committed to accessibility and inclusion, offering adjustments for interview processes and welcoming feedback on our candidate experience. We foster community through Slack channels and communities of practice, covering interests like music, food, pets, and professional development. If you\’d like to connect with these groups, please contact a Made Tech talent team member. Our benefits include flexible schemes like Smart Tech, Cycle to Work, and personalized benefit allowances. We promote connection through social and wellbeing events. Our popular benefits: ️ 30 days Holiday – paid leave plus bank holidays Remote Working – part-time remote options Paid counselling – mental health, legal, and financial advice Candidates must be eligible for SC security clearance, requiring 5 years of UK residency. If eligibility is not confirmed during the process, we cannot proceed with your application. Interested? Join us in using technology to improve society. Our transparent and supportive hiring process guides candidates at each stage, with feedback provided throughout. Shortlisted candidates will be invited for screening. Register your interest to stay updated on relevant roles. #J-18808-Ljbffr