DevOps / SRE Engineer - GenAI / RAG / LLM Platform
Contract | Hybrid/Remote
We are looking for an experienced DevOps / Site Reliability Engineer (SRE) to build and operate production-grade infrastructure for Generative AI, RAG and LLM-based platforms .
This role sits at the intersection of DevOps/SRE, Kubernetes and AI engineering , with a strong focus on deploying, scaling, monitoring and supporting LLM workloads in production.
Key experience
- Strong DevOps or SRE background supporting highly available production platforms.
- Hands-on Kubernetes experience, including deployment, scaling and production operations.
- Experience building or supporting RAG (Retrieval-Augmented Generation) architectures.
- Strong understanding of LLMs and production GenAI workloads.
- Vector database/search experience with Pinecone, Weaviate, pgvector or Azure AI Search .
- Experience with LangChain, LlamaIndex and/or MCP (Model Context Protocol) .
- LLM observability/evaluation experience using LangSmith, Langfuse or Arize .
- Experience deploying or managing models through Hugging Face and/or AWS SageMaker .
- Strong understanding of CI/CD, infrastructure automation, monitoring, reliability and production troubleshooting .
- Ability to work closely with AI/ML and software engineering teams to take GenAI applications from development into reliable production environments.
The role
You’ll help engineer the platform and operational foundations behind LLM and RAG applications , covering Kubernetes infrastructure, model deployment, vector search, observability, reliability and automated paths to production.
This would suit a DevOps/SRE Engineer who has moved into the GenAI/LLM space , rather than a traditional infrastructure engineer with no hands-on AI platform experience.
DevOps / SRE Engineer - GenAI / RAG / LLM Platform in London employer: GCS Recruitment
Join a forward-thinking organisation that values innovation and collaboration, where as a Senior Site Reliability Engineer, you will play a pivotal role in enhancing the reliability and performance of critical banking systems. With a hybrid working model based in Knutsford or Glasgow, you will benefit from a supportive work culture that prioritises continuous improvement and employee growth, alongside opportunities for technical leadership and mentorship. Enjoy a competitive benefits package and the chance to work with cutting-edge technologies in a dynamic environment that fosters professional development.
