At a Glance
- Tasks: Design and evaluate AI responses for relevance and helpfulness in a remote setting.
- Company: Join a forward-thinking company focused on AI quality and personalization.
- Benefits: Earn $11.5/hr with flexible hours and the chance to work from anywhere.
- Other info: Ideal for self-motivated individuals seeking short-term, impactful work.
- Why this job: Make an impact on AI technology while honing your analytical skills.
- Qualifications: Fluent in English with experience in data annotation or AI evaluation.
The predicted salary is between 11.5 - 11.5 £ per hour.
Position: LLM AI Quality Analyst (Personalization) English
Type: Short-Term Contract
Location: Remote
Commitment: 30-40 hours/week
Compensation: $11.5/hr
Engagement Length: 1 month
Start Date: Immediate
Role Responsibilities
- Design multi-turn conversational prompts based on personal context
- Evaluate personalized AI responses for relevance, grounding, and helpfulness
- Assess correct and incorrect use of personal data in model outputs
- Perform side-by-side (SxS) evaluation and ranking of AI responses
- Identify grounding errors, poor inferences, and forced personalization
- Write clear, structured rationales referencing specific conversation turns
- Extract and verify model debug information and data source usage
- Maintain strict data hygiene by deleting evaluation conversations
Requirements
- English fluency (reading and writing)
- Strong experience in data annotation, AI quality evaluation, content moderation, or related roles
- Strong analytical thinking and attention to detail
- Ability to evaluate nuanced and ambiguous AI responses
- Comfortable using a primary personal Google account with enabled data sources
- BS/BA degree or equivalent experience in a relevant analytical field
- Strong written communication and structured feedback skills
- Self-motivated and able to work independently in a remote setting
Data Quality Analyst (English) | $11.5/hr Remote employer: Crossing Hurdles
As a Data Quality Analyst with us, you'll join a dynamic and innovative team dedicated to enhancing AI personalization. We offer a flexible remote work environment that promotes a healthy work-life balance, alongside opportunities for professional growth in the rapidly evolving field of AI. Our culture values collaboration, creativity, and continuous learning, making it an excellent place for those seeking meaningful and rewarding employment.
We think you need these skills to ace Data Quality Analyst (English) | $11.5/hr Remote
Analytical Thinking
Attention to Detail
Data Annotation
AI Quality Evaluation
Content Moderation
Evaluation of AI Responses
Written Communication
