At a Glance
- Tasks: Lead the design of secure data pipelines and mentor a team of engineers.
- Company: Join a UK Central Government programme focused on innovative data solutions.
- Benefits: Remote work flexibility with occasional site visits and competitive contract rates.
- Why this job: Make a real impact by building auditable data platforms for government projects.
- Qualifications: Strong experience in POLE data modelling and AWS data services required.
- Other info: Opportunity to work in a dynamic environment with potential for career advancement.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking an SC Cleared Lead Data Engineer to support a UK Central Government programme focused on building secure, auditable, and intelligence-led data platforms. You will provide technical leadership across data engineering activities, setting standards for data modelling, schema design, and auditability, while working closely with architects, analysts, and delivery teams. This role is highly hands-on and suited to a senior engineer capable of translating complex raw data into structured, trustworthy, and compliant datasets aligned to the POLE (Person, Object, Location, Event) data model.
Key Responsibilities
- Lead the design and delivery of secure, auditable data pipelines within a government environment
- Structure, normalise, and integrate raw data sources into a POLE-aligned data model
- Design and implement schemas aligned to POLE entities, ensuring consistency, extensibility, and performance
- Build and optimise temporal data models, supporting historical truth and time-based analysis
- Implement permission enforcement mechanisms using permission identifiers to control access at data and query level
- Develop data processing workloads using AWS services, including Flink and Glue
- Write and maintain high-quality Java-based data processing code
- Design, implement, and optimise queries in PostgreSQL (or equivalent relational databases)
- Ensure data solutions meet audit, compliance, and information assurance requirements
- Embed database-level audit logging, capturing:
- Who accessed data
- What data was accessed
- When access occurred
- Why access was permitted
Essential Skills & Experience
- Strong experience designing and implementing temporal databases
- Proven expertise in POLE data modelling, including:
- Structuring raw data into POLE
- Designing schemas aligned to POLE entities
- AWS Flink
- AWS Glue
- Schema design
- Query optimisation
- Data normalisation strategies
- Database-level audit logging
- Secure access tracking and traceability
Desirable Experience
- Experience working within UK Central Government or public sector programmes
- Familiarity with data used in law enforcement, intelligence, or investigative contexts
- Experience designing systems for high-assurance or regulated environments
- Prior technical leadership or lead engineer experience on complex data platforms
Lead Data Engineer (SC Cleared) in Preston employer: Lucid Support Services Ltd
Contact Detail:
Lucid Support Services Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer (SC Cleared) in Preston
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who have experience with government projects. A friendly chat can lead to insider info about job openings or even referrals.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best data engineering projects, especially those involving POLE data models or AWS services. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with temporal databases, schema design, and permission enforcement. Practising common interview questions can help you feel more confident.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might be perfect for you. Plus, it’s a great way to ensure your application gets seen by the right people.
We think you need these skills to ace Lead Data Engineer (SC Cleared) in Preston
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with POLE data modelling and AWS services, as these are key for us. Use specific examples that showcase your skills in designing secure and auditable data systems.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Explain why you're passionate about this role and how your background aligns with our needs. Don’t forget to mention your SC Clearance and any relevant experience in government or regulated environments.
Showcase Your Technical Skills: We want to see your technical prowess! Include details about your hands-on experience with Java, PostgreSQL, and AWS services like Flink and Glue. Mention any projects where you’ve implemented permission enforcement or built auditable data systems.
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at Lucid Support Services Ltd
✨Know Your Data Models
Make sure you brush up on your knowledge of POLE data modelling. Be ready to discuss how you've structured raw data into POLE and designed schemas aligned to POLE entities in your previous roles. This will show that you understand the core requirements of the job.
✨Showcase Your Technical Leadership
Prepare examples of how you've acted as a technical authority in past projects. Highlight your experience mentoring engineers and setting best practices. This is crucial for demonstrating your capability to lead data engineering activities effectively.
✨Familiarise Yourself with Compliance Standards
Since this role involves working within a government environment, it's essential to understand audit, compliance, and information assurance requirements. Be ready to discuss how you've ensured data solutions meet these standards in your previous work.
✨Demonstrate Your Hands-On Experience
Be prepared to talk about your hands-on experience with AWS services like Flink and Glue, as well as your Java development background. Share specific examples of data processing workloads you've developed and how you've optimised queries in PostgreSQL or similar databases.