Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Review and improve AI agent evaluation tasks with a focus on logic and completeness.
- Company: Join Mindrift, where innovation meets opportunity in the AI space.
- Benefits: Earn up to $50/hour, enjoy flexible remote work, and enhance your portfolio.
- Why this job: Make a real impact on the future of AI while working on exciting projects.
- Qualifications: Strong analytical skills and attention to detail are essential.
- Other info: Perfect for students seeking valuable experience in a dynamic, remote environment.
The predicted salary is between 40 - 50 £ per hour.
At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.
We are on the hunt for QAs for autonomous AI agents for a new project focused on validating and improving complex task structures, policy logic, and agent evaluation frameworks. Throughout the project, you will have to balance quality assurance, research, and logical problem-solving. This project opportunity is ideal for people who enjoy looking at systems holistically and thinking through scenarios, implications, and edge cases.
Responsibilities:
- Review evaluation tasks and scenarios for logic, completeness, and realism.
- Identify inconsistencies, missing assumptions, or unclear decision points.
- Help define clear expected behaviours (gold standards) for AI agents.
- Annotate cause-effect relationships, reasoning paths, and plausible alternatives.
- Think through complex systems and policies as a human would to ensure agents are tested properly.
- Work closely with QA, writers, or developers to suggest refinements or edge-case coverage.
Requirements:
- Excellent analytical thinking: can reason about complex systems, scenarios, and logical implications.
- Strong attention to detail: can spot contradictions, ambiguities, and vague requirements.
- Familiarity with structured data formats: can read, not necessarily write JSON/YAML.
- Ability to assess scenarios holistically: know what’s missing, what’s unrealistic, what might break.
- Good communication and clear writing (in English) to document findings.
Additional Qualities:
- Experience with policy evaluation, logic puzzles, case studies, or structured scenario design.
- Background in consulting, academia, olympiads (logic/math/informatics), or research.
- Exposure to LLMs, prompt engineering, or AI-generated content.
- Familiarity with QA or test-case thinking (edge cases, failure modes, 'what could go wrong').
- Some understanding of how scoring or evaluation works in agent testing (precision, coverage, etc.).
Benefits:
- Get paid for your expertise, with rates that can go up to $50 per hour depending on your skills, experience, and project needs.
- Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments.
- Participate in an advanced AI project and gain valuable experience to enhance your portfolio.
- Influence how future AI models understand and communicate in your field of expertise.
Location: Remote; flexible schedule.
Seniority Level: Internship
Employment Type: Part-time
Job Function: Other
Industries: IT Services and IT Consulting
Freelance Agent Evaluation Analyst in London employer: Mindrift
Contact Detail:
Mindrift Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Freelance Agent Evaluation Analyst in London
✨Tip Number 1
Network like a pro! Reach out to people in the industry, join relevant online communities, and attend virtual meetups. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio that highlights your analytical thinking and problem-solving abilities. Include examples of how you've tackled complex systems or scenarios in the past—this will make you stand out!
✨Tip Number 3
Prepare for interviews by practising common questions related to QA and AI evaluation. Think about how you would approach edge cases and logical inconsistencies, and be ready to discuss your thought process.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take the initiative to connect with us directly.
We think you need these skills to ace Freelance Agent Evaluation Analyst in London
Some tips for your application 🫡
Show Off Your Analytical Skills: When you're writing your application, make sure to highlight your analytical thinking. We want to see how you approach complex systems and scenarios, so share examples that showcase your problem-solving skills.
Be Detail-Oriented: Attention to detail is key for this role. In your application, mention any experiences where you've had to spot inconsistencies or ambiguities. This will show us that you can handle the nitty-gritty of evaluation tasks.
Communicate Clearly: Good communication is essential, so make sure your application is well-written and easy to understand. We appreciate clarity, so avoid jargon and keep it straightforward. Remember, we’re looking for clear documentation of findings!
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates about the process. Let’s get started!
How to prepare for a job interview at Mindrift
✨Understand the Project Scope
Before your interview, make sure you thoroughly understand the project at Mindrift. Familiarise yourself with the concepts of AI agents, evaluation frameworks, and quality assurance. This will help you speak confidently about how your skills align with their needs.
✨Showcase Your Analytical Skills
Prepare to discuss specific examples where you've demonstrated strong analytical thinking. Think about times when you've tackled complex systems or scenarios, and be ready to explain your thought process. This will highlight your ability to reason through the intricacies of the role.
✨Communicate Clearly
Since good communication is key for this position, practice articulating your thoughts clearly and concisely. You might even want to write down some points about your experiences and findings related to AI evaluation to ensure you can convey them effectively during the interview.
✨Ask Insightful Questions
Prepare a few thoughtful questions about the project and the team at Mindrift. This shows your genuine interest in the role and helps you assess if the company culture aligns with your values. Questions about their approach to QA or how they handle edge cases can be particularly relevant.