At a Glance
- Tasks: Design and maintain scalable data pipelines in a collaborative, multidisciplinary team.
- Company: Join a government client making a real difference with data technology.
- Benefits: Competitive salary, excellent pension, hybrid working, and 10 learning days per year.
- Other info: Work from various locations and enjoy professional development opportunities.
- Why this job: Use your skills for public good while tackling interesting data challenges.
- Qualifications: Experience in Python and cloud data solutions, with strong communication skills.
The predicted salary is between 44618 - 54533 £ per year.
Cloud Data Engineer (Python)
Up to £54,150 per annum + excellent pension | Hybrid working | London, Manchester, Cardiff, Belfast, Edinburgh or Darlington
Are you an experienced Data or Software Engineer with hands-on experience of:
Python and end to end Cloud deployment, looking for a role where your work can make a real difference?
Our Government client is looking for a Data Engineer to join its Data, Technology and Insights (DTI) unit on a 12-month fixed-term contract.
You’ll join a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists and digital forensics experts, working on data processing and analytical projects for both internal team and user-initiated projects.
This is a hands-on role where you’ll spend most of your time designing, building and maintaining data solutions, with plenty of opportunity for learning and professional development.
The Role
- As a Data Engineer, you’ll help build and operate reliable, scalable data infrastructure and pipelines across an AWS cloud environment.
Producing high-quality code in Python (and other languages, as needed).
Your responsibilities will include
- Design, build and maintain scalable data pipelines to ingest, transform and process large and complex datasets.
- Develop automated web scraping and bulk data acquisition workflows.
- Implement data transformation, validation, testing and quality controls to ensure datasets are reliable, reproducible and ready for analysis.
- Build and maintain containerised data and analytics applications, including dashboards and data tools.
- Implement and manage workflow orchestration and scheduling to ensure data pipelines and jobs are observable, reliable and maintainable.
- Apply Infrastructure as Code (Ia C) to support data pipelines and processing workflows on AWS.
- Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).
- Work closely with data scientists, analysts and engineers to translate analytical and operational requirements into effective data solutions.
- Contribute to a collaborative, multidisciplinary environment and share knowledge with colleagues.
About You
We’re looking for a Data or Software Engineer who has experience delivering production data solutions and enjoys solving complex data problems.
Essential experience
- Experience delivering production data pipelines end-to-end, including design, development, implementation and operational maintenance in a cloud environment.
- Experience writing production-quality Python to work with complex, messy or large datasets (Minimum 2 years)
- An undergraduate degree in a quantitative subject, or equivalent professional experience in data engineering, data science or cloud development.
- A strong understanding of data engineering best practices, including data modelling, transformation, validation, testing.
- Experience working collaboratively within multidisciplinary teams.
- Strong communication skills, with the ability to explain technical work clearly and engage with non-technical audiences.
Why Join?
This is an opportunity to use your technical expertise on diverse projects that have a meaningful impact on the public good.
You’ll work alongside specialists from a range of disciplines, tackling interesting and complex data challenges while continuing to develop your technical skills.
You’ll also receive
- £49,400 salary + DDAT Allowance of up to £4,750 dependent upon experience
- Excellent pension
- 12-month fixed-term contract
- Hybrid working
- Choice of office location: London, Manchester, Cardiff, Belfast, Edinburgh or Darlington
- Opportunities for learning and professional development including 10 L & D days per annum.
- The opportunity to work with experienced data, technology and analytical specialists
- Apply Now
If you’re an experienced Data or Software Engineer with strong Python and Cloud experience and want to use your skills in a role with genuine public impact, we’d love to hear from you
Data Engineer in Manchester employer: SmartSourcing Ltd
As a Brand Strategist with our public sector client in London, you will be part of a dynamic team dedicated to shaping and protecting a unique brand that serves the community. The company fosters a collaborative work culture that values innovation and creativity, offering flexible hybrid working arrangements that promote work-life balance. With a commitment to employee growth, you will have access to professional development opportunities that empower you to excel in your role and make a meaningful impact on government services.