Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Evaluate and improve AI systems through structured testing and analysis.
- Company: Mindrift connects specialists with exciting AI project opportunities.
- Benefits: Earn up to $50/hour, flexible hours, and project-based work.
- Why this job: Make a real impact on cutting-edge AI technology while working on your own schedule.
- Qualifications: 3+ years in software development, strong Python skills, and Git experience.
- Other info: Join a dynamic team and enhance your skills in a fast-paced environment.
The predicted salary is between 39 - 44 £ per hour.
Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What This Opportunity Involves
- Create structured test cases that simulate complex human workflows
- Define gold-standard behavior and scoring logic to evaluate agent actions
- Analyze agent logs, failure modes, and decision paths
- Work with code repositories and test frameworks to validate your scenarios
- Iterate on prompts, instructions, and test cases to improve clarity and difficulty
- Ensure that scenarios are production-ready, easy to run, and reusable
What We Look For
This opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have:
- 3+ years of software development experience with strong Python focus
- Experience with Git and code repositories
- Comfortable with structured formats like JSON/YAML for scenario description
- Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design
- Familiarity with Docker
- English proficiency - B2
How It Works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Project time expectations
Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Payment
Paid contributions, with rates up to $50/hour* Fixed project rate or individual rates, depending on the project. Some projects include incentive payments. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
Freelance Agent Evaluation Engineer employer: Mindrift
Contact Detail:
Mindrift Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Freelance Agent Evaluation Engineer
✨Tip Number 1
Network like a pro! Reach out to your connections in the tech industry and let them know you're on the lookout for freelance opportunities. You never know who might have a lead or can refer you to someone looking for your skills.
✨Tip Number 2
Showcase your skills online! Create a portfolio that highlights your best work, especially projects related to AI and software development. This will give potential clients a taste of what you can do and make you stand out from the crowd.
✨Tip Number 3
Stay active on platforms where freelance gigs are posted. Websites like ours at StudySmarter are perfect for finding project-based roles. Regularly check for new listings and apply quickly to increase your chances of landing that gig!
✨Tip Number 4
Prepare for interviews by brushing up on common questions related to AI evaluation and software testing. Be ready to discuss your experience with Python, Git, and any relevant tools. Confidence is key, so practice makes perfect!
We think you need these skills to ace Freelance Agent Evaluation Engineer
Some tips for your application 🫡
Craft a Stellar CV: Make sure your CV is up-to-date and highlights your relevant experience, especially your Python skills and any work with AI systems. Tailor it to showcase how your background aligns with the tasks mentioned in the job description.
Show Off Your English Skills: Since we need to know your level of English proficiency, be clear about it in your application. If you have any certifications or examples of your English usage in a professional context, include those to back up your claim.
Be Specific About Your Experience: When detailing your past projects, focus on your experience with structured formats like JSON/YAML and any familiarity with Docker. This will help us see how you can contribute to our projects right away.
Apply Through Our Website: We encourage you to apply directly through our website for a smoother process. It’s the best way for us to receive your application and get you started on your journey with us!
How to prepare for a job interview at Mindrift
✨Know Your Stuff
Make sure you brush up on your Python skills and be ready to discuss your experience with Git and code repositories. Familiarise yourself with structured formats like JSON and YAML, as these will likely come up in conversation.
✨Understand the Role
Dive deep into what the role of a Freelance Agent Evaluation Engineer entails. Be prepared to talk about how you would create structured test cases and evaluate agent actions. Showing that you understand the nuances of AI evaluation will impress your interviewers.
✨Showcase Your Problem-Solving Skills
Be ready to discuss past projects where you tackled complex problems, especially those related to LLM limitations like hallucinations and bias. Use specific examples to illustrate how you approached these challenges and what you learned from them.
✨Communicate Clearly
Since English proficiency is key, practice articulating your thoughts clearly and concisely. This will not only help you during the interview but also demonstrate your ability to create clear and reusable scenarios in your work.
