At a Glance
- Tasks: Create expert-level prompts and test them against advanced AI models.
- Company: Join a forward-thinking team in the AI evaluation space.
- Benefits: Earn $50β$70/hour, work remotely, and enjoy flexible hours.
- Why this job: Make an impact in AI while utilising your expertise in a dynamic role.
- Qualifications: Advanced knowledge in STEM, law, finance, or similar fields required.
- Other info: Part-time commitment with opportunities for collaboration and growth.
The predicted salary is between 39 - 52 Β£ per hour.
Position: Expert Prompt Curator β Advanced AI Evaluation Dataset
Type: Hourly contract
Compensation: $50β$70/hour
Location: Remote
Commitment: Part-time, short-term (10β20 hours/week)
Role Responsibilities
- Create original, expert-level prompts requiring tool use (e.g., search, browse, code execution)
- Ensure prompts are objective, self-contained, and yield clear, unambiguous answers
- Test prompts against advanced AI models and document successes and failure cases
- Provide complete reasoning steps and authoritative solutions for each prompt
- Classify prompts by subject domain for dataset organization
- Collaborate with reviewers to validate and refine prompt quality
Requirements
- Advanced academic or professional expertise in a specialized domain (STEM, law, finance, history, cultural studies, or similar)
- Strong ability to design high-difficulty questions requiring deep domain knowledge and external references
- Experience in research, benchmarking, or test-question design preferred
- Excellent attention to detail and ability to provide concise reasoning explanations
- Familiarity with AI models and their limitations is a plus
AI Evaluation Expert | $70/hr Remote in London employer: Crossing Hurdles
Contact Detail:
Crossing Hurdles Recruiting Team
StudySmarter Expert Advice π€«
We think this is how you could land AI Evaluation Expert | $70/hr Remote in London
β¨Tip Number 1
Network like a pro! Reach out to folks in your field on LinkedIn or other platforms. A friendly chat can open doors that a CV just can't.
β¨Tip Number 2
Show off your skills! Create a portfolio or a personal website showcasing your expertise and projects. This is your chance to shine beyond the application.
β¨Tip Number 3
Prepare for interviews by practising common questions and scenarios related to AI evaluation. We want you to feel confident and ready to impress!
β¨Tip Number 4
Apply through our website! Itβs the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take that extra step.
We think you need these skills to ace AI Evaluation Expert | $70/hr Remote in London
Some tips for your application π«‘
Show Off Your Expertise: Make sure to highlight your advanced academic or professional expertise in your application. We want to see how your background aligns with the role, so donβt hold back on showcasing your knowledge in STEM, law, finance, or any relevant field!
Craft Clear and Concise Prompts: Since the role involves creating expert-level prompts, give us a taste of your skills by including examples of clear, objective prompts in your application. This will help us see your thought process and how you approach prompt design.
Detail Your Experience: If you've got experience in research, benchmarking, or test-question design, make sure to detail that in your application. We love seeing how candidates have tackled similar challenges in the past, so share those stories with us!
Apply Through Our Website: We encourage you to apply through our website for a smoother process. Itβs the best way for us to keep track of your application and ensure it gets the attention it deserves. Plus, itβs super easy!
How to prepare for a job interview at Crossing Hurdles
β¨Know Your Domain Inside Out
Make sure you brush up on your specialised knowledge in STEM, law, finance, or whichever field you're applying for. Be ready to discuss complex concepts and demonstrate your expertise during the interview.
β¨Showcase Your Prompt Crafting Skills
Prepare examples of prompts you've created in the past. Highlight how they were designed to be objective and self-contained, and be ready to explain the reasoning behind them. This will show your understanding of what makes a good prompt.
β¨Familiarise Yourself with AI Models
Since the role involves testing prompts against advanced AI models, itβs crucial to understand their capabilities and limitations. Brush up on the latest developments in AI to discuss how you would approach testing and refining prompts.
β¨Collaboration is Key
Be prepared to talk about your experience working with others to validate and refine work. Share examples of how you've collaborated in the past, as teamwork will be essential in this role.