At a Glance
- Tasks: Join a dynamic team to design and maintain scalable data pipelines for impactful projects.
- Company: Government client focused on public good with a diverse, multidisciplinary team.
- Benefits: £49,400 salary, excellent pension, and opportunities for learning and development.
- Other info: Inclusive workplace that values diversity and promotes equality.
- Why this job: Make a difference by applying your data skills in a meaningful way.
- Qualifications: Experience in data engineering, Python coding, and cloud environments required.
Data Engineer (AWS) 12-month FTC, Canary Wharf, London One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC).
They are offering £49,400 per annum plus excellent pension.
This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts.
What you’ll do
- Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.
- Spend most of your time on hands-on technical work with support for learning and professional development.
- Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources.
This can include automated web scraping and bulk data acquisition workflows.
- Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.
- Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.
- Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
- Apply Infrastructure as Code (Ia C) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
- Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).
- Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions. What you’ll need:
- Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)
- An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)
- Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)
- Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
- Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
- Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences Smart Sourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all
Data Engineer (AWS) in Canary Wharf employer: SmartSourcing Ltd
SmartSourcing Ltd. is an excellent employer that values its employees by offering a competitive salary and a comprehensive benefits package, including private healthcare and a generous holiday allowance. The work culture promotes collaboration and growth, providing opportunities for professional development in a supportive environment, all while enjoying the picturesque setting of Marlow.