Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Evaluate AI prompts and conduct Red Teaming to ensure safety and quality.
- Company: Innodata Inc. connects talent with opportunities in the AI and IT sectors.
- Benefits: Flexible part-time hours, remote work options, and a chance to work with cutting-edge technology.
- Other info: Ideal for those passionate about AI safety and looking to grow in a fast-paced environment.
- Why this job: Join a dynamic team focused on ethical AI and make a real impact in tech.
- Qualifications: Experience in AI testing, strong analytical skills, and familiarity with prompt engineering required.
The predicted salary is between 30000 - 42000 £ per year.
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Innodata Inc.
Global Recruiter | Connecting Talent & Opportunity Worldwide | Expert in Cross-Cultural & AI/LLM Specialist Hiring
Job Description:
We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.
Key Responsibilities:
- Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
- Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
- Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
- Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
- Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
- Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
- Document findings, edge cases, and vulnerability reports with high clarity and structure.
Requirements:
- Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
- Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
- Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
- Understanding of LLM behaviors, failure modes, and model evaluation metrics.
- Excellent critical thinking, pattern recognition, and analytical writing skills.
- Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
Preferred Qualifications:
- Prior work with teams like OpenAI, Anthropic, Google DeepMind, or other LLM safety initiatives.
- Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.
Seniority level
-
Seniority level
Associate
Employment type
-
Employment type
Part-time
Job function
-
Job function
Writing/Editing
-
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Innodata Inc. by 2x
Sign in to set job alerts for “Content Writer” roles.
London, England, United Kingdom 2 days ago
Greater London, England, United Kingdom 2 days ago
London, England, United Kingdom 6 days ago
Freelance Content Writer (Remote, Contract) – London
London, England, United Kingdom 3 months ago
London, England, United Kingdom 2 weeks ago
Manchester, England, United Kingdom 2 days ago
St Albans, England, United Kingdom 2 days ago
Freelance Content Writer (Remote, Contract) – Birmingham
Birmingham, England, United Kingdom 3 months ago
Stoke-On-Trent, England, United Kingdom 2 days ago
Edinburgh, Scotland, United Kingdom 2 days ago
Southampton, England, United Kingdom 2 days ago
COPYWRITER WITH ENGLISH (US) TECH/MEDICAL – Remote Job
London, England, United Kingdom 3 weeks ago
Coventry, England, United Kingdom 2 days ago
Glasgow, Scotland, United Kingdom 2 days ago
GCSE/ International GCSE – Mathematics – Content Author – Fully Remote
London, England, United Kingdom 3 weeks ago
Greater London, England, United Kingdom 3 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Prompt Evaluator employer: Innodata Inc.
Contact Detail:
Innodata Inc. Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Prompt Evaluator
✨Tip Number 1
Familiarise yourself with the latest trends in AI and LLMs. Understanding current technologies and methodologies will not only help you during interviews but also demonstrate your genuine interest in the field.
✨Tip Number 2
Network with professionals in the AI and tech industry. Attend relevant meetups, webinars, or conferences to connect with people who might provide insights or even referrals for the Prompt Evaluator role.
✨Tip Number 3
Brush up on your analytical skills by practising with real-world AI-generated content. Create your own test cases and evaluate them to gain hands-on experience that you can discuss during your interview.
✨Tip Number 4
Prepare to discuss ethical considerations in AI during your interview. Being able to articulate your understanding of safety, compliance, and ethical standards will set you apart as a candidate who is not only skilled but also responsible.
We think you need these skills to ace Prompt Evaluator
Some tips for your application 🫡
Understand the Role: Before applying, make sure to thoroughly understand the responsibilities and requirements of the Prompt Evaluator position. Familiarise yourself with concepts like Red Teaming, AI/LLM Quality Assurance, and prompt evaluation.
Tailor Your CV: Customise your CV to highlight relevant experience in AI red teaming, quality assurance, and any specific projects that demonstrate your analytical skills. Use keywords from the job description to align your application with what the company is looking for.
Craft a Strong Cover Letter: Write a compelling cover letter that showcases your passion for AI safety and your analytical abilities. Mention specific experiences that relate to the job, such as previous roles in testing AI systems or working with LLMs.
Showcase Your Analytical Skills: In your application, provide examples of how you've successfully identified vulnerabilities or assessed risks in past projects. Highlight your critical thinking and pattern recognition skills, as these are crucial for the role.
How to prepare for a job interview at Innodata Inc.
✨Showcase Your Analytical Skills
During the interview, be prepared to discuss your analytical approach to evaluating AI-generated content. Share specific examples from your past experiences where you identified vulnerabilities or assessed risks in AI systems.
✨Familiarise Yourself with Red Teaming
Make sure you understand the principles of Red Teaming and how it applies to AI/LLM safety testing. Be ready to explain how you would conduct exercises to identify harmful outputs and what methodologies you would use.
✨Demonstrate Knowledge of Ethical Considerations
Since ethical considerations are crucial in generative AI, prepare to discuss your understanding of these issues. Highlight any relevant experience you have in ensuring compliance with safety and quality standards.
✨Prepare for Technical Questions
Expect technical questions related to prompt engineering and NLP tasks. Brush up on your knowledge of LLM behaviours, failure modes, and evaluation metrics to confidently answer any queries that may arise.