Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Evaluate and enhance multilingual datasets for large language models, focusing on cultural nuances.
- Company: Join a forward-thinking team dedicated to improving AI language understanding and cultural sensitivity.
- Benefits: Flexible working hours, remote work options, and opportunities for professional growth.
- Why this job: Make a real impact on AI by ensuring it understands diverse cultures and languages.
- Qualifications: Native English speaker with a Master's degree and experience in LLM evaluation preferred.
- Other info: Part-time role requiring 25 to 30 hours per week.
We are looking for linguistically and culturally aware professionals to support the evaluation and enhancement of multilingual prompt-response datasets for large language models (LLMs). This role involves rubric design, evaluation of translations and model outputs, prompt creation, and red teaming focused on identifying and surfacing cultural nuances and biases in LLM behaviour.
Key Responsibilities:
- Rubric Definition & Prompt Evaluation
- Update rubric definitions with region/language-specific examples to ensure cultural and linguistic relevance.
- Identify the need for additional rubrics tailored to specific languages or regional contexts.
- Review prompts translated from English into the target language and revise where translations appear unnatural or inaccurate.
- Writing of thoughtful prompts which can test the cultural awareness of LLM models.
- Rate prompt-response pairs using a standardized evaluation template based on rubrics and provide detailed justifications to base the findings.
- Document problematic outputs and annotate them with clear explanations of rubric violations or cultural insensitivities.
Required Qualifications:
- Native proficiency in the target language (English) and deep familiarity with cultural norms in the corresponding region.
- Experience in LLM evaluation, content moderation, or linguistic QA preferred.
- Strong attention to detail with the ability to identify subtle issues in language use, tone, and cultural references.
- Comfortable working in spreadsheets and evaluation templates.
- Master’s degree in relevant stream.
Preferred Qualifications:
- Prior experience with prompt engineering or LLM testing.
- Familiarity with tools such as Gemini, ChatGPT or similar LLM platforms.
- Ability to clearly articulate reasoning behind rubric ratings or prompt edits.
Required Engagement: 25 to 30 hours per week.
Content Writer employer: Innodata Inc.
Contact Detail:
Innodata Inc. Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Content Writer
✨Tip Number 1
Familiarise yourself with the latest trends in LLM evaluation and cultural nuances. This will not only help you understand the role better but also allow you to engage in meaningful conversations during interviews.
✨Tip Number 2
Showcase your understanding of cultural contexts by preparing examples of how you've previously navigated linguistic challenges or biases. This can be a great talking point when discussing your experience.
✨Tip Number 3
Network with professionals in the field of LLM evaluation and content moderation. Attend relevant webinars or join online forums to connect with others who can provide insights or even referrals.
✨Tip Number 4
Be prepared to discuss specific tools and platforms you’ve used in your previous roles. Familiarity with tools like Gemini or ChatGPT can set you apart, so make sure to highlight any relevant experience.
We think you need these skills to ace Content Writer
Some tips for your application 🫡
Understand the Role: Before applying, make sure you fully understand the responsibilities of a Content Writer in the context of LLM evaluation. Familiarise yourself with rubric design, prompt creation, and cultural nuances to tailor your application effectively.
Highlight Relevant Experience: In your CV and cover letter, emphasise any experience you have in LLM evaluation, content moderation, or linguistic quality assurance. Be specific about your familiarity with cultural norms and how it relates to the role.
Craft a Tailored Cover Letter: Write a compelling cover letter that addresses the key qualifications listed in the job description. Use examples from your past work to demonstrate your attention to detail and ability to identify subtle language issues.
Proofread Your Application: Ensure your application is free from errors. Given the focus on language and cultural nuances, a well-proofread application will reflect your attention to detail and professionalism.
How to prepare for a job interview at Innodata Inc.
✨Showcase Your Linguistic Skills
Make sure to highlight your native proficiency in English and any other languages you may know. Discuss your familiarity with cultural norms and how they influence language use, as this is crucial for the role.
✨Demonstrate Attention to Detail
Prepare examples that showcase your ability to identify subtle issues in language use, tone, and cultural references. This could involve discussing past experiences where you successfully navigated these challenges.
✨Familiarise Yourself with LLMs
Research large language models and their evaluation processes. Be ready to discuss your experience with tools like Gemini or ChatGPT, and how you've used them in previous roles or projects.
✨Prepare Thoughtful Prompts
Think of creative and culturally relevant prompts that could be used to test LLMs. Be prepared to explain your reasoning behind these prompts and how they align with the rubric definitions.
