At a Glance
- Tasks: Lead the design of secure data pipelines and mentor a team of engineers.
- Company: Join a UK Central Government programme focused on innovative data solutions.
- Benefits: Remote work flexibility with occasional site visits and competitive contract rates.
- Other info: Opportunity to work in a dynamic environment with potential for career advancement.
- Why this job: Make a real impact by building auditable data platforms for government projects.
- Qualifications: Strong experience in POLE data modelling and AWS data services required.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking an SC Cleared Lead Data Engineer to support a UK Central Government programme focused on building secure, auditable, and intelligence-led data platforms. You will provide technical leadership across data engineering activities, setting standards for data modelling, schema design, and auditability, while working closely with architects, analysts, and delivery teams. This role is highly hands-on and suited to a senior engineer capable of translating complex raw data into structured, trustworthy, and compliant datasets aligned to the POLE (Person, Object, Location, Event) data model.
Key Responsibilities
- Lead the design and delivery of secure, auditable data pipelines within a government environment
- Structure, normalise, and integrate raw data sources into a POLE-aligned data model
- Design and implement schemas aligned to POLE entities, ensuring consistency, extensibility, and performance
- Build and optimise temporal data models, supporting historical truth and time-based analysis
- Implement permission enforcement mechanisms using permission identifiers to control access at data and query level
- Develop data processing workloads using AWS services, including Flink and Glue
- Write and maintain high-quality Java-based data processing code
- Design, implement, and optimise queries in PostgreSQL (or equivalent relational databases)
- Ensure data solutions meet audit, compliance, and information assurance requirements
- Embed database-level audit logging, capturing:
- Who accessed data
- What data was accessed
- When access occurred
- Why access was permitted
Essential Skills & Experience
- Strong experience designing and implementing temporal databases
- Proven expertise in POLE data modelling, including:
- Structuring raw data into POLE
- Designing schemas aligned to POLE entities
- AWS Flink
- AWS Glue
- Schema design
- Query optimisation
- Data normalisation strategies
- Database-level audit logging
- Secure access tracking and traceability
Desirable Experience
- Experience working within UK Central Government or public sector programmes
- Familiarity with data used in law enforcement, intelligence, or investigative contexts
- Experience designing systems for high-assurance or regulated environments
- Prior technical leadership or lead engineer experience on complex data platforms
Lead Data Engineer (SC Cleared) in Plymouth employer: Lucid Support Services Ltd
Contact Detail:
Lucid Support Services Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer (SC Cleared) in Plymouth
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who have experience with government projects. A friendly chat can lead to insider info about job openings or even referrals.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best work, especially projects that align with POLE data modelling and AWS services. This will give potential employers a taste of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with temporal databases and permission enforcement mechanisms, as well as how you’ve led teams in the past.
✨Tip Number 4
Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Plus, it’s a great way to ensure your application gets the attention it deserves.
We think you need these skills to ace Lead Data Engineer (SC Cleared) in Plymouth
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with POLE data modelling and AWS services, as these are key for us. Use specific examples that showcase your skills in designing secure and auditable data systems.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Explain why you're passionate about this role and how your background aligns with our needs. Don’t forget to mention your SC Clearance and any relevant experience in government or regulated environments.
Showcase Your Technical Skills: We want to see your technical prowess! Include details about your hands-on experience with Java, PostgreSQL, and AWS services like Flink and Glue. Mention any projects where you’ve implemented permission enforcement or built auditable data systems.
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at Lucid Support Services Ltd
✨Know Your POLE Inside Out
Make sure you have a solid understanding of the POLE data model. Be ready to discuss how you've structured raw data into POLE and designed schemas aligned to its entities. This will show your technical expertise and ability to lead data engineering activities.
✨Showcase Your AWS Skills
Since this role involves using AWS services like Flink and Glue, prepare to talk about your hands-on experience with these tools. Bring examples of how you've built and optimised data processing workloads in the past, as this will demonstrate your practical knowledge.
✨Highlight Your Compliance Experience
Given the focus on auditability and compliance, be ready to discuss your experience with building auditable data systems. Talk about how you've implemented database-level audit logging and permission enforcement mechanisms in previous roles to ensure data security.
✨Prepare for Technical Leadership Questions
As a Lead Data Engineer, you'll need to mentor others and set best practices. Think of examples where you've acted as a technical authority or led a team. Be prepared to discuss how you approach mentoring and ensuring compliance within a team setting.