Description
Responsibilities
- Execute annotation, evaluation, and validation activities for AI-powered solutions using established guidelines and quality standards.
- Validate AI-generated outputs against a predefined set of golden questions and expected results.
- Create, maintain, and review annotations to support AI model evaluation and continuous improvement.
- Test and evaluate Databricks Genie responses for accuracy, completeness, relevance, and consistency.
- Write and execute SQL queries against underlying data sources to validate answers generated from golden questions and Databricks Genie outputs.
- Investigate discrepancies between expected results, source data, and AI-generated responses, and document findings.
- Lead the design, optimization, and standardization of annotation processes and prompts across multiple AI use cases.
- Collaborate with AI teams to define and govern annotation schemas, taxonomies, evaluation frameworks, and quality standards.
- Review complex or high-risk AI outputs and provide expert quality assessments and recommendations.
- Ensure consistency, accuracy, traceability, and auditability of annotation and evaluation results.
- Define reusable prompt frameworks and best practices aligned with business, compliance, and responsible AI objectives.
- Evaluate prompt performance and annotation quality metrics, identifying opportunities for improvement through data-driven insights.
- Establish quality benchmarks, calibration processes, and escalation procedures.
- Identify bias, hallucinations, and other AI risks, and recommend mitigation strategies.
- Support AI governance, compliance, and responsible AI initiatives.
- Participate in calibration sessions to align on annotation standards, quality expectations, and evaluation criteria.
- Collaborate closely with AI engineers, data scientists, product teams, and business stakeholders.
- Drive continuous process improvement through learning new AI technologies, annotation methodologies, and delivery approaches.
- Mentor and coach junior and intermediate annotators and prompt engineers.
Qualifications
Bachelors - Computer Engineering, Bachelors - Computer Science, Bachelors - Information Technology, Masters - Software Engineering
Certifications
Certified Software Quality Analyst (CSQA) - RomtrainingRomtraining, Certified Software Tester (CSTE) - TricentisTricentis, Hexawise Test Professional Certification - HexawiseHexawise, ISTQB Certified Tester - International Society for Technology in Education (ISTE)International Society for Technology in Education (ISTE), Selenium Basics - Great LearningGreat Learning
Required Skills
Data Annotation, Databricks AI/BI Genie, SQL Query Writing
Language
English
Language Proficiency
Advanced - C1
Job Type
Fixed Term (Fixed Term)
Job End Date
2027-03-22
Master Skill List
Testing & Quality Assurance P
Remote Type
Office
Work Shift
Standard (United Kingdom)
Why join Genpact?
- Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
- Make an impact – Help global enterprises solve business challenges that matter
- Accelerate your career – Gain hands‑on experience, mentorship, and world‑class learning opportunities to stay ahead
- Work with the best – Join 140,000+ bold thinkers and problem‑solvers who push boundaries every day
- Thrive in a values‑driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
#J-18808-Ljbffr
Tech Lead - Testing & Quality Assurance P 4C employer: 9752 Genpact (UK) Limited
Genpact is an excellent employer that fosters a dynamic and inclusive work culture, where innovation thrives in a hybrid UK setting. Employees benefit from comprehensive professional development opportunities, mentorship from experienced leaders, and the chance to work on cutting-edge AI-driven projects that make a real impact. With a strong commitment to employee well-being and growth, Genpact stands out as a rewarding place for those looking to advance their careers in risk advisory.
