Engineering (PhD) [$73.29/hr]
Role Responsibilities
- Write and refine prompts to guide model behavior in engineering scenarios
- Evaluate LLM-generated responses to engineering-related queries for technical accuracy, applied reasoning, and completeness
- Conduct fact-checking and verify any technical claims using authoritative public sources and domain knowledge
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
- Assess clarity, structure, and appropriateness of explanations for different audiences
- Ensure model responses align with expected conversational behavior and system guidelines
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Good Candidature
- PhD in Engineering or a closely related field
- Deep expertise in one or more of the following sub-domains:
- Mechanical & Physical Systems Engineering
- Electrical, Electronic & Computer Engineering
- Chemical, Materials & Process Engineering
- Civil, Environmental & Infrastructure Engineering
- Significant experience using large language models (LLMs) and understand how and why people use them
- Excellent writing skills and can clearly explain complex engineering concepts
- Strong attention to detail and consistently notice subtle issues others may overlook
- Experience reviewing or editing technical or academic writing
Nice-to-Have Specialties
- Experience with applied research, industry engineering workflows, or systems design
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience teaching, mentoring, or explaining engineering concepts to non-expert audiences
- Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
Contact Detail:
Great Value Hiring Recruiting Team