At a Glance
- Tasks: Define and implement evaluation strategies for cutting-edge AI conversational systems.
- Company: Join a forward-thinking tech company in the heart of London.
- Benefits: Enjoy a competitive salary, hybrid work model, and opportunities for growth.
- Other info: Dynamic role with a focus on collaboration and creativity.
- Why this job: Be at the forefront of AI innovation and shape the future of conversational technology.
- Qualifications: Experience in evaluation framework design and metrics establishment is essential.
The predicted salary is between 80000 - 100000 £ per year.
Work Location: London
Type of work: Contract
Mode of work: Hybrid
Responsibilities:
- Define and implement end-to-end evaluation strategy for generative AI conversational systems (LLMs, RAG pipelines, agents).
- Establish evaluation metrics.
- Test dataset data analysis, evaluation pipelines.
- Prompt evaluation tools (PromptTools, DeepEval, etc.).
Experience with:
- Evaluation Framework Design.
- Establish Evaluation metrics.
AI Evaluation Engineer employer: Vallum Associates
Vallum Associates is an excellent employer, offering a dynamic work environment in Necton that prioritises safety and efficiency in major infrastructure projects. With a strong focus on employee growth, we provide opportunities for professional development and training in the electrical sector, fostering a culture of collaboration and innovation. Join us to be part of a team that values your contributions and supports your career advancement in a vital industry.
We think you need these skills to ace AI Evaluation Engineer
Python
SQL
Problem-Solving Skills
Data Engineering
Communication Skills
Data Pipeline Development
API Integration
