At a Glance
- Tasks: Define evaluation strategies and build automated pipelines for cutting-edge AI solutions.
- Company: Join a leading enterprise in London, embracing innovation and collaboration.
- Benefits: Enjoy a hybrid work model, competitive pay, and opportunities for professional growth.
- Other info: Be part of a dynamic team focused on continuous AI optimisation.
- Why this job: Make an impact in the AI field while working with advanced technologies.
- Qualifications: Experience with LLMs, RAG architectures, and Python for data analysis.
The predicted salary is between 70100 - 98000 £ per year.
Location: London (Hybrid – 1 day onsite)
Contract: 6–12 Months
We're looking for an AI Evaluation Engineer to help deliver and optimise cutting‑edge Generative AI solutions within a large enterprise environment.
Key Responsibilities
- Define and implement evaluation strategies for LLMs, RAG pipelines and AI agents
- Build automated evaluation pipelines and benchmarking frameworks
- Establish evaluation metrics and create test datasets
- Evaluate prompt quality, model performance and response accuracy
- Validate RAG knowledge grounding and conduct safety, risk and compliance testing
- Support human‑in‑the‑loop evaluation and continuous AI optimisation
Required Skills
- Strong experience with LLMs, RAG architectures and prompt engineering
- Python for data analysis and evaluation pipelines
- Experience with AI evaluation tools such as DeepEval, PromptTools or similar
- Knowledge of NLP quality assessment, benchmarking and experimentation frameworks
- Understanding of Responsible AI principles
AI Evaluation Engineer in London employer: Gazelle Global
Join a leading organisation at the forefront of cyber security transformation in London, where you will play a pivotal role in delivering critical initiatives. Our collaborative work culture fosters innovation and growth, offering ample opportunities for professional development and advancement within a dynamic environment. With competitive rates and a commitment to employee well-being, we ensure that our team members thrive both personally and professionally.
