Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Evaluate AI models, ensuring accuracy and reliability through real-world testing and feedback.
- Company: Join a forward-thinking AI company shaping the future of technology.
- Benefits: Flexible freelance hours with competitive pay based on your skills and experience.
- Why this job: Make a real impact in AI development while working remotely and flexibly.
- Qualifications: Experience in AI QA, strong analytical skills, and knowledge of evaluation tools.
- Other info: Perfect for tech-savvy individuals looking to grow in a dynamic field.
The predicted salary is between 5 - 55 £ per hour.
Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow's AI can democratise world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability.
Responsibilities
- Converse with the model on real-world scenarios and evaluation prompts.
- Verify factual accuracy and logical soundness.
- Design and run test plans and regression suites.
- Build clear rubrics and pass/fail criteria.
- Capture reproducible error traces with root-cause hypotheses.
- Suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs).
- Partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time.
Qualifications
- A bachelor’s, master’s, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal.
- Shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit.
- Skills that stand out include evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting.
- Clear, metacognitive communication—"showing your work"—is essential.
Pay & Benefits
We offer a pay range of $6-to-$65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
Employment Type: Contract
Workplace: Remote
Seniority Level: Mid-Senior Level
AI QA Trainer - LLM Evaluation - Freelance Project in London employer: Invisible Expert Marketplace
Contact Detail:
Invisible Expert Marketplace Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land AI QA Trainer - LLM Evaluation - Freelance Project in London
✨Tip Number 1
Network like a pro! Reach out to folks in the AI QA space on LinkedIn or at industry events. A friendly chat can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your work with LLM evaluation and test automation. This is your chance to shine and demonstrate what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on common questions related to AI QA and LLMs. Practice articulating your thought process clearly—remember, communication is key!
✨Tip Number 4
Don't forget to apply through our website! We love seeing candidates who take the initiative to connect directly with us. It shows you're serious about joining the team!
We think you need these skills to ace AI QA Trainer - LLM Evaluation - Freelance Project in London
Some tips for your application 🫡
Tailor Your Application: Make sure to customise your CV and cover letter for the AI QA Trainer role. Highlight your experience with LLM evaluation, test automation, and any relevant projects that showcase your skills. We want to see how you fit into our vision!
Showcase Your Expertise: Don’t hold back on sharing your knowledge! Include specific examples of your work with evaluation rubrics, adversarial testing, or any hands-on experience with LLM eval tooling. This is your chance to shine and show us what you can bring to the table.
Be Clear and Concise: When writing your application, clarity is key. Use straightforward language and avoid jargon unless it’s necessary. We appreciate a well-structured application that makes it easy for us to understand your qualifications and thought process.
Apply Through Our Website: We encourage you to submit your application directly through our website. It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, it’s super easy—just follow the prompts!
How to prepare for a job interview at Invisible Expert Marketplace
✨Know Your AI Inside Out
Make sure you brush up on the latest advancements in AI and large-scale language models. Familiarise yourself with the specific tools mentioned in the job description, like OpenAI Evals and regression testing frameworks. Being able to discuss these topics confidently will show your passion and expertise.
✨Prepare Real-World Scenarios
Think of practical examples where you've applied your QA skills in AI or ML systems. Prepare to discuss how you’ve designed test plans, captured error traces, or improved evaluation metrics. This will help you demonstrate your hands-on experience and problem-solving abilities.
✨Showcase Your Communication Skills
Since clear communication is key for this role, practice explaining complex concepts in a simple way. Be ready to 'show your work' during the interview, whether it’s through discussing your thought process or presenting your findings from past projects.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's approach to AI QA and their expectations for the role. This not only shows your interest but also helps you gauge if the company aligns with your career goals. Plus, it gives you a chance to engage in a meaningful conversation.
