AI Infrastructure Architect in Fife

About Huawei Research and Development UK Limited Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We have 207,000 employees and operate in over 170 countries and regions, serving more than three billion people around the world. Our vision and mission is to bring digital to every person, home and organization for a fully connected, intelligent world.

This spirit of innovation has led Huawei to work in close partnership with leading academic institutions in the UK to develop and refine the latest technologies. The partnership between UK and Huawei helps to develop the technologies of the future that will transform the way we all communicate, work and live.

Huawei's vision is a fully connected, intelligent world. To achieve this, we work to inspire passion for basic research around the world. Our combined passion drives development across the global innovation value chain. Huawei has the largest Research and Development organization in the world with 96,000+ employees in research centers around the globe. In the UK, we already have design centers in Cambridge, London, Edinburgh and Ipswich.

In an era where computing power is evolving toward full intelligence, AI training and inference are driving a comprehensive reconstruction of the foundational software stack. With the launch of Huawei CloudMatrix super-node clusters, the architectures for AI model training, inference, and agent systems are undergoing unprecedented transformation.

In this role, you will help define and build:

• AI-native Runtime and Serving framework: Redesign inference execution paths, orchestration logic, model lifecycle and data flows to fully exploit super-node hardware features such as memory pooling and fully interconnected high-speed fabrics.
• Agentic AI core infrastructure: Provides base-level state management, KV-Cache system, and efficient retrieval capabilities for agent memory, tool calling, workflow execution, and multi-agent collaboration.
• Next-generation serverless AI: Implements Function-as-a-Service (FaaS) Inference, near instantaneous scaling, multi-model hybrid loading, cold start optimization, and peak throughput mode on the unified Runtime.
• Performance and cost engineering at ultra scale: Deliver industry-leading performance, latency, and cost efficiency under scenarios such as billion-level QPS, multi-model sharing/co-hosting, and multi-tenant isolation.

This job description is only an outline of the tasks, responsibilities and outcomes required of the role. The jobholder will carry out any other duties as may be reasonably required by his/her line manager.

Key Responsibilities:

• Architecture Planning: Design a unified AI Infra & Serving architecture platform for composite AI workloads such as LLM Training & Inference, RLHF, Agent, and Multimodal processing.
• Agent Serving Framework: Design a heterogeneous execution framework across CPU/GPU/NPU for agent memory, tool invocation, and long-running multi-turn conversations and tasks.
• Serverless AI Foundation Design: Build a high-performance Runtime/Framework that defines the next-generation Serverless AI foundation.
• Performance and Cost Optimization: Leverage Huawei's self-developed hardware stack and End–Edge–Cloud co-optimization.
• Frontier Technology Insights: Continuously track cutting-edge developments in Serverless AI, LLM Serving, and Agentic AI.
• Cross-Team Collaboration: Serve as a Team leader, working closely with accelerator, operating system, cloud platform, and AI application teams.

Person Specification:

Required:

• Strong foundational knowledge in system architecture.
• Serverless & Cloud-Native experience.
• Expertise in AI Serving.
• Experience in Agentic AI domains.
• Performance analysis and optimization skills.
• Programming and engineering capabilities.
• Communication and architectural articulation skills.

Desired:

• Experience in production deployment of LLM Serving/Agent/Serverless platforms.
• Significant technical achievements or peer-reviewed publications.
• Active contribution or a Maintainer role in open-source communities.
• Experience in leading teams to deliver architectural implementations.

What we offer:

• 33 days annual leave entitlement per year (including UK public holidays).
• Group Personal Pension.
• Life insurance.
• Private medical insurance.
• Medical expense claim scheme.
• Employee Assistance Program.
• Cycle to work scheme.
• Company sports club and social events.
• Additional time off for learning and development.