Director of Data Engineering: AI & Data Platforms in London

Location: London (Hybrid – 1–2 days per week onsite)

Salary: Up to £140,000 + equity & benefits

Reports to: CTO

Overview of the Role

This is a rare opportunity to shape and lead the evolution of a next-generation, AI-native data platform within a high-growth, well-funded scale-up. As Director of Data Engineering, you will operate at the intersection of strategy and execution—partnering closely with the CTO to define the long-term architecture, build a high-performing team, and transition the organisation from a traditional data platform to an agentic, AI-driven ecosystem.

You will inherit a capable team, but more importantly, you will define its future: how it scales, what it builds, and where it leverages external innovation. This role combines hands-on technical leadership (circa 50%) with team and organisational leadership (circa 50%), making it ideal for a builder-leader who thrives on both architecture and people.

Key Responsibilities

• Strategic Leadership & Platform Vision
  • Partner with the CTO to define and execute the AI and data platform strategy, including critical build vs buy decisions
  • Establish a clear approach to partner vs upskill, ensuring the team leverages external innovation while building core internal capability
  • Shape the long-term vision for an agentic, AI-native data ecosystem
• AI-Driven Data Platform Development
  • Lead the design of a unified AI search layer, combining vector, keyword, and graph-based approaches (e.g. GraphRAG)
  • Architect and scale agent-based systems and human-in-the-loop workflows
  • Oversee the development of a knowledge graph and data enrichment pipelines to unlock proprietary data value
  • Drive AI/ML Ops maturity, including LLM deployment, RAG pipelines, and evaluation frameworks
• Engineering & Architecture
  • Define scalable, cloud-native architectures across GCP (preferred) and AWS
  • Lead cross-cloud data orchestration, ensuring seamless data flow from ingestion to intelligence layers
  • Guide technical decisions on tooling, frameworks, and platform evolution
• Team Leadership & Growth
  • Lead and develop a team of data and AI engineers, including senior and staff-level contributors
  • Build a culture of engineering excellence, accountability, and continuous improvement
  • Hire, mentor, and scale the team in line with business growth
• Delivery & Impact
  • Ensure engineering effort is focused on high-value, domain-specific problems
  • Improve velocity through modern engineering practices and AI-assisted development
  • Balance innovation with pragmatism—avoiding unnecessary reinvention while maintaining competitive advantage

Key Requirements

• Leadership & Experience
  • Proven experience as a Director or Senior Engineering Manager leading data/platform teams
  • Strong track record of scaling teams and mentoring engineers (typically 5+ years in leadership roles)
  • Comfortable operating in a hands-on leadership capacity
• Data Platform & Cloud Expertise
  • Experience building and scaling high-volume data platforms
  • Strong knowledge of GCP (BigQuery preferred) and exposure to AWS
  • Expertise in data pipelines, distributed processing, and Python-based data services
• AI & Emerging Technologies
  • Exposure to or strong interest in agentic systems, LLMs, and AI-driven architectures
  • Experience with AI search (vector databases, hybrid search, GraphRAG) is highly desirable
  • Familiarity with knowledge graphs, ontologies, or complex data modelling
• Strategic & Commercial Thinking
  • Experience making build vs buy and technology investment decisions
  • Ability to evaluate and integrate third-party tools, platforms, and partnerships
  • Strong alignment with business outcomes, not just technical delivery

Additional Information

• Working Pattern: Hybrid (1–2 days per week in London office)
• Salary: Up to £140,000 + equity + benefits (private healthcare, pension)
• Team Size: ~4–5 engineers currently, scaling further
• Career Progression: Clear path towards VP Engineering / CTO
• Environment: Stable, well-funded scale-up (not early-stage chaos)
• Highly unique, proprietary datasets
• Strong investment in modern AI tooling and practices

Interview Process (3 Stages)

• Introductory conversation with senior leadership
• Technical/design interview (architecture-focused)
• Final interview with executive stakeholders (in-person)

This role is ideal for a senior engineering leader who wants to build, shape, and scale not just maintain. If you're motivated by cutting-edge AI, complex data challenges, and genuine strategic influence, this is an opportunity to make a lasting impact.