AI Evaluation Engineer β€” LLM & RAG Quality

AI Evaluation Engineer β€” LLM & RAG Quality

Full-Time 60000 - 80000 Β£ / year (est.) No working from home possible
Vallum Associates

At a Glance

  • Tasks: Define and implement evaluation strategies for generative AI systems and build robust benchmarks.
  • Company: Vallum Associates, a forward-thinking tech company in London.
  • Benefits: Hybrid working, competitive pay, and opportunities for professional growth.
  • Other info: Dynamic role with a focus on innovation and collaboration.
  • Why this job: Join a cutting-edge team and shape the future of AI technology.
  • Qualifications: Experience in AI evaluation, LLMs, and strong analytical skills.

The predicted salary is between 60000 - 80000 Β£ per year.

Vallum Associates in London is seeking an AI Evaluation Engineer on a contract basis with hybrid working.

You will define and implement end-to-end evaluation strategies for generative AI systems, build robust benchmarks, and drive improvements.

The role focuses on LLMs, RAG pipelines, prompt engineering, and safety/compliance testing, with emphasis on automated pipelines and human-in-the-loop validation.

#J-18808-Ljbffr

AI Evaluation Engineer β€” LLM & RAG Quality employer: Vallum Associates

Vallum Associates is an excellent employer, offering a dynamic work environment in Necton that prioritises safety and efficiency in major infrastructure projects. With a strong focus on employee growth, we provide opportunities for professional development and training in the electrical sector, fostering a culture of collaboration and innovation. Join us to be part of a team that values your contributions and supports your career advancement in a vital industry.

Vallum Associates

Contact Details:

Vallum Associates Recruitment Team

We think you need these skills to ace AI Evaluation Engineer β€” LLM & RAG Quality

Python
SQL
Problem-Solving Skills
Data Engineering
Attention to Detail
Communication Skills
Data Pipeline Development