Job Description Data Engineer Clearance Required: Active SC Clearance (Mandatory) \n The Opportunity \n We're looking for a talented Data Engineer to join a growing team delivering secure, large-scale data solutions for government and public sector customers. \n This is an exciting opportunity to work on complex data platforms that support critical decision-making and operational outcomes. You'll play a key role in building and enhancing secure batch and real-time data processing capabilities, working with modern cloud technologies and industry-leading open-source tools. \n As part of a collaborative Agile team, you'll help design, develop, and optimise data pipelines, ensuring data is accurately processed, transformed, and delivered to downstream consumers. This role offers exposure to cutting-edge cloud and data technologies alongside the opportunity to work on meaningful projects within highly secure environments. \Unfortunately, sponsorship or clearance applications cannot be supported for this role. \n Key Responsibilities \n \n Develop, test, and maintain robust data pipelines that meet both functional and non-functional business requirements. \n Design, build, and optimise data processing solutions to support batch and real-time analytics capabilities. \n Contribute to logical and physical database design activities across a range of data platforms. \n Expand and enhance platform capabilities, enabling the business to solve new and evolving data challenges. \n Analyse complex datasets and identify opportunities to improve data processing, quality, and performance. \n Ensure data models align with established data architecture standards, maintaining consistency across entities, relationships, and definitions. \n Perform root cause analysis on data-related issues, identifying and implementing effective solutions. \n Collaborate with engineers, architects, and stakeholders to deliver scalable and reliable data solutions. \n Support continuous improvement initiatives, helping to drive best practices across data engineering and platform development. \n Produce clear technical documentation covering data pipelines, processes, and system enhancements. \n \n Skills & Experience \n Essential \n \n Experience developing and maintaining data pipelines using modern data processing technologies and frameworks. \n Knowledge of Agile delivery methodologies and experience working within fast-paced development environments. \n Strong understanding of data modelling , data structures, and their advantages and limitations across different use cases. \n Experience working with public cloud platforms , particularly AWS , including services such as EC2, RDS, Lambda, Athena, and Glue . \n Experience configuring and optimising Relational and NoSQL databases, including query tuning and performance optimisation. \n Proficiency in programming and scripting languages such as Python . \n Experience applying Test-Driven Development (TDD) methodologies and associated testing frameworks. \n Strong analytical and problem-solving skills with the ability to work through complex data challenges. \n Bachelor's degree or equivalent commercial experience in a relevant discipline. \n Knowledge of configuration management tools including Ansible and Packer . \n Experience using Terraform for Infrastructure-as-Code deployments. \n Understanding of both Linux and Windows environments. \n Exposure to modern cloud-native architectures and DevOps practices. \n \n What You'll Bring \n \n A passion for data engineering and solving complex technical problems. \n A strong attention to detail and commitment to delivering high-quality solutions. \n A collaborative mindset and the ability to work effectively within Agile teams. \n The ability to translate business requirements into scalable and efficient data solutions. \n A desire to contribute to projects that deliver meaningful impact within secure and mission-critical environments. \n \n Security Clearance - Mandatory Requirement \n Candidates must hold current and active SC (Security Check) Clearance at the time of application. \n This is an excellent opportunity to join a high-performing engineering team, working on innovative cloud and data platforms that support critical government
Lead Data Engineer (AWS) in Cheltenham employer: Sanderson Government and Defence
As a Lead Network Engineer in Salisbury, you will join a dynamic team dedicated to maintaining and enhancing a critical network capability within a secure environment. Our company fosters a culture of collaboration and innovation, offering extensive opportunities for professional growth and development while prioritising diversity and inclusion. With a commitment to employee well-being and a supportive work atmosphere, we ensure that our team members thrive both personally and professionally.
Contact Details:
Sanderson Government and Defence Recruitment Team
