Lead Data Engineer - Remote in Swansea

hackajob is collaborating with Made Tech to connect them with exceptional professionals for this role. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-led, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll help implement efficient data pipelines & storage.

Key Responsibilities:

• Define, shape and perfect data strategies in central and local government.
• Help public sector teams understand the value of their data, and make the most of it.
• Establish yourself as a trusted advisor in data-driven approaches using public cloud services like AWS, Azure and GCP.
• Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
• Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes).
• Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
• Create reusable libraries to encourage uniformity across multiple data pipelines.
• Document and present end-to-end diagrams to explain a data processing system on a cloud environment.
• Experience of working on agile delivery-led projects and applying agile practices such as Scrum, XP, Kanban.
• Own the cloud infrastructure underpinning data systems through a DevOps approach.
• Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
• Deliver data platforms as a skilled Data Engineer.
• Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
• Demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.
• Improve resilience into a project by checking for software vulnerabilities and implementing appropriate testing strategies (unit integration, data quality, etc).
• Offer guidance on implementing a robust DevOps approach in a data project.
• Discuss tools needed such as DataOps in areas such as orchestration, data integration and data analytics.
• Work with Docker and virtual environments as part of the development and CI/CD process.
• Collaborate with a team of engineers using techniques such as pair programming or mob programming.
• Work with data scientists to productionise advanced data deliverables, such as machine learning models.
• Collaborate with multidisciplinary digital and technology teams.

We’re committed to building a happy, inclusive and diverse workforce. We use Slack to foster a sense of community and connection, with special interest groups and dedicated learning spaces called communities of practice (COPs). If you’d like to speak to someone from one of these groups about their experience as an employee, please do let a member of the Made Tech talent team know.

Benefits:

• 30 days of paid annual leave.
• Flexible parental leave options.
• Part-time remote working for all staff.
• Paid counselling as well as financial and legal advice.
• Pension scheme.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. Eligibility for SC requires 5 years' UK residency and 5 years' employment history (or back to full-time education).

We help organisations transform, deliver and manage world-class digital products and services. We’re helping local authorities make it easier and quicker for people to log housing repairs online and digitalising access to NHS services. We’re also driving better environmental outcomes by improving network performance through real-time asset monitoring.

We were recently named as a finalist in the Raising the Bar for Workplace Transparency Award in the Shift People Awards.