Responsibilities:
- Develop and optimise SQL queries to retrieve, manipulate and analyse complex datasets.
- Build data solutions using Python, including working within notebook-based environments.
- Integrate data from APIs and investigate issues within API responses and associated datasets.
- Work confidently with a variety of data formats, including JSON, CSV and Excel.
- Build, manage and improve automated data pipelines supporting both ETL and ELT approaches.
- Carry out data validation and quality checks to identify inconsistencies, errors and processing issues.
- Diagnose and resolve problems across data pipelines, integrations and datasets.
- Design and maintain database structures that support scalable and reliable data solutions.
- Work within established government security, delivery and data management environments.
About you:
- Strong hands-on SQL capability, particularly for querying, transforming and analysing data.
- Commercial experience using Python for data engineering or data processing.
- Experience developing and working within notebook-based environments.
- Good understanding of REST APIs and the ability to interpret and troubleshoot responses.
- Experience handling structured and semi-structured data, including JSON, CSV and Excel.
- Proven experience creating and supporting automated ETL/ELT pipelines.
- Strong understanding of data validation, data quality and troubleshooting.
- Experience designing databases and underlying data structures.
- Active SC clearance is mandatory.
- Must have worked within a UK Government department during the last 12 months.
Data Engineer (Security Clearence) in London employer: FDM Group Careers
FDM is an exceptional employer that values innovation and collaboration, offering a dynamic work environment in the heart of Edinburgh. As a Senior CMDB Manager, you will have the opportunity to shape and enhance the Configuration Management capabilities while enjoying a hybrid work model that promotes work-life balance. With a strong focus on employee growth, FDM provides access to continuous learning and development opportunities, ensuring that you can advance your career while contributing to meaningful projects within the Financial Services sector.
