Lead Data Engineer (MI6)

Requirements

• You’re a curious, motivated person who enjoys solving problems in unstructured environments where no two challenges look the same. You’re comfortable working independently, building data pipelines and developing robust data models, with strong core technical skills grounded in areas like data modelling or Python-based ecosystems rather than low-code tools
• You bring a creative, inquisitive mindset and a habit of learning by doing – prototyping, experimenting, and continuously building on your understanding
• You feel comfortable engaging with both technical and non-technical audiences, translating complex ideas into clear, actionable insights, and you enjoy shaping solutions collaboratively
• At this level, you’ll bring either deep technical expertise or strong leadership experience, whether that’s mentoring others or managing people. You’ll also have exposure to modern AI and LLM-enabled workflows, including testing, evaluation, and ethical considerations

What the job involves

• Enhancing how we operate today will better prepare us for the challenges of tomorrow. That’s why we’re creating dedicated teams focused on bringing Artificial Intelligence (AI) into some of our most mission critical areas. As a Lead Data Engineer, you’ll work in a truly unique environment where data supports MI6’s frontline teams and core enterprise operations
• Day to day, you’ll lead the design, build and optimisation of secure, scalable data pipelines across complex environments, ensuring sensitive, high-volume data is onboarded, processed and used safely and effectively. You’ll work closely with operational officers, analysts, engineers and partners to integrate new data sources and enable advanced, AI-driven workflows. Acting as a bridge between technical and non-technical stakeholders, you’ll help translate requirements into practical, high-impact solutions
• Along with leading technical delivery, you’ll provide direct engineering leadership, mentoring junior engineers and shaping best practice across teams. You’ll also support the evaluation and integration of LLMs and agentic AI systems, including testing, ethics and policy considerations, while driving exploration and prototyping of emerging technologies to build future capability