AI RAG Engineer

AI RAG Engineer

Full-Time 36000 - 60000 £ / year (est.) No home office possible
Go Premium
L

At a Glance

  • Tasks: Design and deploy AI systems with a focus on retrieval-augmented generation.
  • Company: Join a fast-moving startup revolutionising intelligent systems with large language models.
  • Benefits: Enjoy hands-on impact, ownership, and the chance to shape tech strategy.
  • Why this job: Work on real AI features that reach users and prioritise quality over mere demos.
  • Qualifications: Experience with LLMs, Python, and building RAG pipelines is essential.
  • Other info: Visa sponsorship available for qualified candidates.

The predicted salary is between 36000 - 60000 £ per year.

We are a fast-moving startup building intelligent systems powered by large language models. We are looking for a software engineer who can design, build, and deploy AI systems end-to-end — especially those involving retrieval-augmented generation (RAG), embeddings, and LLM orchestration. This is a hands-on role with real impact and ownership.

What You’ll Work On

  • Architect and implement RAG pipelines that combine vector search, custom retrievers, and LLM reasoning
  • Own the evaluation stack — design eval harnesses, benchmarks, and regression tests for LLM outputs
  • Build and scale infrastructure for deploying models and agents into real production environments
  • Experiment with model behavior, latency trade-offs, and prompt tuning
  • Collaborate closely with founders on product, architecture, and research priorities

Core Requirements

  • Proven experience building AI systems with LLMs — you’ve worked with tools like LangChain, LlamaIndex, Haystack, or built your own stack
  • Hands-on with embedding models, vector DBs (e.g., FAISS, Weaviate, Qdrant), and retrieval logic
  • Strong Python engineering skills — you write clean, production-ready code with tests
  • Experience building and evaluating RAG pipelines in a real-world setting
  • Familiarity with LLM evaluation techniques — you don’t deploy until you’ve tested against real metrics
  • Solid understanding of modern cloud infrastructure (e.g., Docker, Kubernetes, serverless, GCP/AWS)

Bonus Skills

  • Built custom eval pipelines using tools like Ragas, TruLens, or your own scoring systems
  • Experience tuning open-source models (e.g., Mistral, LLaMA, Falcon) or working with APIs (OpenAI, Anthropic, Cohere)
  • Exposure to agentic systems, tools + memory management, or multi-step reasoning chains
  • Experience in fast-paced, early-stage startup environments

Why This Role Is Unique

  • You’ll be engineering AI features that ship to users, not just running experiments
  • Evaluation is first-class — we’re serious about quality, not just 'it looks good in the demo'
  • You’ll help shape both tech strategy and engineering culture from day one
  • We care more about what you’ve built than where you’ve worked

You should apply if: You’re an engineer who enjoys building production-grade AI systems, and you believe evals, not vibes, should drive development. You’re comfortable moving fast, debugging strange model behavior, and taking real ownership of the tech.

Note, this company is sponsoring visas.

L

Contact Detail:

LinkedIn Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land AI RAG Engineer

✨Tip Number 1

Familiarise yourself with the specific tools mentioned in the job description, such as LangChain and Haystack. Having hands-on experience with these tools will not only boost your confidence but also demonstrate your commitment to the role.

✨Tip Number 2

Engage with the AI community by participating in forums or attending meetups focused on retrieval-augmented generation and LLMs. Networking with professionals in the field can provide valuable insights and potentially lead to referrals.

✨Tip Number 3

Prepare to discuss your previous projects involving AI systems during the interview. Be ready to explain your thought process, the challenges you faced, and how you overcame them, as this will showcase your problem-solving skills.

✨Tip Number 4

Stay updated on the latest trends and advancements in AI and LLM technologies. Being knowledgeable about current developments will help you engage in meaningful conversations with the founders and demonstrate your passion for the field.

We think you need these skills to ace AI RAG Engineer

Experience with large language models (LLMs)
Proficiency in Python programming
Knowledge of retrieval-augmented generation (RAG) pipelines
Familiarity with embedding models and vector databases (e.g., FAISS, Weaviate, Qdrant)
Ability to design and implement evaluation harnesses and benchmarks
Understanding of LLM evaluation techniques
Experience with cloud infrastructure (e.g., Docker, Kubernetes, GCP/AWS)
Hands-on experience with AI system deployment
Strong problem-solving skills
Ability to collaborate effectively with cross-functional teams
Experience in fast-paced startup environments
Familiarity with model tuning and APIs (e.g., OpenAI, Anthropic, Cohere)
Knowledge of agentic systems and multi-step reasoning chains
Attention to detail in code quality and testing

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with AI systems, particularly with large language models and retrieval-augmented generation. Use specific examples of projects you've worked on that align with the job description.

Craft a Compelling Cover Letter: In your cover letter, express your passion for building AI systems and your understanding of the company's mission. Mention any relevant tools or technologies you’ve used, such as LangChain or vector databases, to demonstrate your fit for the role.

Showcase Your Projects: If possible, include links to your GitHub or portfolio showcasing projects related to AI systems, especially those involving RAG pipelines or LLMs. This will give the hiring team a clear view of your hands-on experience.

Highlight Evaluation Techniques: Discuss your familiarity with evaluation techniques for LLMs in your application. Mention any specific metrics or benchmarks you have used in past projects to show that you prioritise quality and performance in your work.

How to prepare for a job interview at LinkedIn

✨Showcase Your Technical Skills

Be prepared to discuss your experience with large language models and retrieval-augmented generation. Highlight specific projects where you've implemented RAG pipelines or worked with tools like LangChain or Haystack.

✨Demonstrate Problem-Solving Abilities

Expect technical questions that assess your ability to troubleshoot and optimise AI systems. Share examples of how you've tackled challenges in model behaviour or latency trade-offs in previous roles.

✨Discuss Evaluation Techniques

Since the company values quality evaluation, be ready to explain your approach to testing LLM outputs. Talk about any custom evaluation harnesses or benchmarks you've designed and how they improved your projects.

✨Emphasise Collaboration and Ownership

This role involves close collaboration with founders and taking ownership of tech decisions. Share experiences where you worked in a team to shape product direction or made significant contributions to project outcomes.

AI RAG Engineer
LinkedIn
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

L
  • AI RAG Engineer

    Full-Time
    36000 - 60000 £ / year (est.)

    Application deadline: 2027-07-11

  • L

    LinkedIn

Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>