At a Glance
- Tasks: Design and build secure data pipelines using Python and Apache Spark.
- Company: Join a public sector team focused on impactful data-driven services.
- Benefits: Competitive salary, flexible working, and opportunities for professional growth.
- Other info: Collaborative Agile environment with great career advancement potential.
- Why this job: Make a difference in the public sector while working with cutting-edge technology.
- Qualifications: Strong Python skills and experience with AWS and Apache Spark.
The predicted salary is between 63000 - 77000 £ per year.
We're looking for a skilled Software Developer to join a public sector delivery team working on data-driven services. You'll design, build, and maintain robust, secure, and scalable data pipelines and applications, working closely with data engineers, analysts, and platform teams.
Day to day duties:
- Developing and maintaining data pipelines and processing jobs using Apache Spark and Python
- Orchestrating workflows with Apache Airflow
- Provisioning and managing cloud infrastructure on AWS using Terraform (Infrastructure as Code)
- Containerising applications and services with Docker
- Managing source control, CI/CD pipelines, and deployments through GitLab
- Integrating automated security scanning into the development pipeline to ensure code and dependencies meet public sector security standards
- Using Jupyter Notebooks for data exploration, prototyping, and analysis
- Building and maintaining integrations with DWP Integration Team products and services
- Collaborating with cross-functional teams in an Agile environment, contributing to design reviews, code reviews, and documentation
Essential Skills Experience:
- Strong hands-on experience with Python
- Experience with Apache Spark for large-scale data processing
- Practical knowledge of AWS services (eg S3, Lambda, EC2, Glue, RDS - adjust as relevant)
Software Developer - SC Cleared employer: Mayfleet Recruitment Limited
As a leading employer in the tech industry, we offer a fully remote working environment tailored for UK-based professionals, ensuring flexibility and work-life balance. Our culture fosters innovation and collaboration, providing ample opportunities for personal and professional growth through continuous learning and exposure to cutting-edge technologies. Join us to be part of a dynamic team that values your contributions and supports your career aspirations while working on impactful projects.
Contact Details:
Mayfleet Recruitment Limited Recruitment Team
