Data Engineer - NPPV3 cleared in Lincoln

Data Engineer (Azure/ETL/Data Platform) - Hybrid
Clearance: NPPV3 preferred
We have a requirement for a Data Engineer to join a growing data function, supporting the design, build and optimisation of a modern data platform.
You will be responsible for developing scalable data pipelines, ETL processes, and data integration solutions, enabling high-quality data to drive analytics, reporting, and business insight.
This is a hands-on role working closely with data analysts, BI developers, and stakeholders to deliver reliable, efficient, and secure data solutions.
Key Responsibilities
Data Engineering & Pipeline Development

• Design, build, and maintain scalable ETL pipelines
• Develop robust processes to extract, transform, and load data from multiple sources
• Optimise data pipelines for performance, reliability, and scalability
• Write and maintain ETL scripts to support data integration and analytics

Data Integration & Management

• Combine and structure datasets to enable insight generation and analytics
• Clean, transform, and store data to maximise usability and value
• Automate manual data processes to enable repeatability and efficiency

Collaboration & Stakeholder Engagement

• Work with stakeholders to understand data requirements and translate into technical solutions
• Collaborate with analysts and BI developers to support reporting and visualisation
• Provide guidance on effective use of data infrastructure

Data Quality & Governance

• Implement data quality checks, validation, and cleansing processes
• Ensure data accuracy, integrity, and consistency
• Adhere to data governance, privacy, and security standards (eg GDPR)
• Support data anonymisation and secure data handling

Support & Troubleshooting

• Diagnose and resolve data pipeline and dataset issues
• Ensure timely delivery of high-quality data
• Monitor and improve pipeline performance

Documentation & Best Practice

• Document data flows, pipelines, and technical processes
• Contribute to development of data engineering standards and best practices

Continuous Improvement

• Stay current with modern data engineering tools and technologies
• Recommend improvements to tooling, processes, and architecture

Essential Skills & Experience

• Strong experience in data engineering and ETL pipeline development
• Proficiency in SQL and at least one Scripting language (Python or R)
• Experience working with large and complex datasets
• Strong understanding of relational databases and data structures
• Experience integrating and transforming data from multiple sources
• Knowledge of data governance, security, and compliance
• Strong analytical and problem-solving skills
• Excellent communication and collaboration skills

Desirable Skills

• Experience with Azure Data Factory, Synapse, or similar ETL tools
• Familiarity with cloud platforms (Azure or AWS)
• Exposure to Power BI or data visualisation tools
• Experience building automated testing for data pipelines
• Public sector or regulated environment experience

Additional Requirements

• NPPV3 clearance preferred
• Eligibility/willingness to undergo security clearance