DevOps / SRE Engineer - GenAI / RAG / LLM Platform
Contract | Hybrid/Remote
We are looking for an experienced DevOps / Site Reliability Engineer (SRE) to build and operate production-grade infrastructure for Generative AI, RAG and LLM-based platforms.
This role sits at the intersection of DevOps/SRE, Kubernetes and AI engineering, with a strong focus on deploying, scaling, monitoring and supporting LLM workloads in production.
Key experience
- Strong DevOps or SRE background supporting highly available production platforms.
- Hands-on Kubernetes experience, including deployment, scaling and production operations.
- Experience building or supporting RAG (Retrieval-Augmented Generation) architectures.
- Strong understanding of LLMs and production GenAI workloads.
- Vector database/search experience with Pinecone, Weaviate, pgvector or Azure AI Search.
- Experience with LangChain, LlamaIndex and/or MCP (Model Context Protocol).
- LLM observability/evaluation experience using LangSmith, Langfuse or Arize.
- Experience deploying or managing models through Hugging Face and/or AWS SageMaker.
- Strong understanding of CI/CD, infrastructure automation, monitoring, reliability and production troubleshooting.
- Ability to work closely with AI/ML and software engineering teams to take GenAI applications from development into reliable production environments.
The role
You’ll help engineer the platform and operational foundations behind LLM and RAG applications, covering Kubernetes infrastructure, model deployment, vector search, observability, reliability and automated paths to production.
This would suit a DevOps/SRE Engineer who has moved into the GenAI/LLM space, rather than a traditional infrastructure engineer with no hands-on AI platform experience.
DevOps / SRE Engineer - GenAI / RAG / LLM Platform employer: GCS Recruitment
Join a forward-thinking organisation that values innovation and collaboration, where as a Senior Site Reliability Engineer, you will play a pivotal role in enhancing the reliability and performance of critical banking systems. With a hybrid working model based in Knutsford or Glasgow, you will benefit from a supportive work culture that prioritises continuous improvement and employee growth, alongside opportunities for technical leadership and mentorship. Enjoy a competitive benefits package and the chance to work with cutting-edge technologies in a dynamic environment that fosters professional development.
