Senior Engineer, Data Engineering in London

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services, ensuring maximum value to data consumers, including analysts, scientists, and business stakeholders.

As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on, supporting as a senior contributor for a project, focusing on both delivering engineering work and upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account.

You’ll ensure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.

• Gathering and meeting the requirements of both clients and users on a data project.
• Owning the cloud infrastructure underpinning data systems through a DevOps approach.
• Knowledge of handling and transforming various data types (JSON, CSV, etc.) with Apache Spark, Databricks or Hadoop.
• Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them.
• Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines, with an understanding of how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
• Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how to present diagrams (C4, UML etc.).
• To provide guidance on implementing a robust DevOps approach in a data project, including tools needed for DataOps in areas such as orchestration, data integration and data analytics.
• Experience in improving resilience into a project by checking for software vulnerabilities and implementing appropriate testing strategies (unit, integration, data quality etc.).
• Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
• Agile practices such as Scrum, XP, and/or Kanban.
• Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases.
• Demonstrating a commercial mindset when on projects to grow accounts organically with senior stakeholders.
• Working with Docker and virtual environments as part of the development and CI/CD process.
• Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
• Working with data scientists to productionise advanced data deliverables, such as machine learning models.
• Working with multidisciplinary digital and technology teams.

If you need this job description in another format, or other support in applying, please email talent@madetech.n. When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application.

We’re committed to building a happy, inclusive and diverse workforce.

We’ve recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan.

• 30 days Holiday - we offer 30 days of paid annual leave + bank holidays!
• Flexible Parental Leave - we offer flexible parental leave options.
• Remote Working - we offer part-time remote working for all our staff.
• Paid counselling as well as financial and legal advice.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. We help organisations transform, deliver and manage world-class digital products and services.

We’re helping local authorities make it easier and quicker for people to log housing repairs online. By digitalising access to NHS services, we’re making it more accessible, such as children needing mental health support. We’re helping to drive better environmental outcomes by improving network performance through real-time asset monitoring, which means less wasted energy.

We were recently named as a finalist in the Raising the Bar for Workplace Transparency Award in the Shift People Awards.