Overview
As an AI Quality Specialist at Ideagen, you apply real-world Quality practice to shape how AI systems understand and respond to Quality scenarios in regulated industries. You will work within Product R&D to set defensible Quality labeling and evaluation standards for AI training data and outputs. The role focuses on ensuring accuracy, regulatory integrity, and defensible decision-making across non-conformances, CAPAs, audits, and regulatory questions. You’ll collaborate with AI engineers and product teams to translate practitioner insight into safer, compliant AI behavior. This is a mission-driven opportunity to scale expert quality judgment across AI solutions used by thousands of Quality
Responsibilities
- Apply annotation guidelines for Quality training data set by the AI Domain Lead and ensure defensible labeling decisions
- Label Quality datasets at scale using practitioner-level judgement to classify non-conformances, evaluate CAPA plans, and categorize audit and supplier quality issues
- Evaluate AI outputs against expert rubrics, document where responses are incorrect and what a compliant answer should look like
- Test AI capabilities against complex Quality scenarios, including ambiguous root causes and regulatory edge cases
- Contribute to red-team testing by identifying challenging scenarios and multi-standard regulatory situations
- Curate and validate Quality regulatory reference materials for accuracy and traceability
- Participate in calibration sessions with specialists to maintain consistency and high evaluation standards
- Collaborate with AI engineers and product teams to turn practitioner feedback into model improvements
Key requirements
- Solid operational experience in Quality within a regulated industry (manufacturing, medical devices, pharmaceuticals, aerospace, automotive, or food & beverage)
- Hands-on experience with non-conformance management, CAPA investigation and review, and audits
- Strong analytical and written communication skills with ability to justify correctness and compliance
- Ability to handle large volumes of detailed evaluation work with accuracy
- Comfortable applying professional judgement where standards require interpretation
- Willingness to challenge plausible but incorrect outputs to ensure regulatory integrity
- Interest in contributing to AI for regulated environments even if not technical
- analytical thinking
- clear written communication
- ambitious to maintain regulatory integrity
- Annotation labeling for Quality datasets
- CAPA evaluation and evidence-based assessment
- Audit and regulatory interpretation within QA context
AI Specialist (Quality) employer: Ideagen Plc
At Ideagen, we pride ourselves on being an exceptional employer that fosters a culture of innovation and collaboration. As a Mobile Engineer, you'll not only have the opportunity to work on cutting-edge mobile products that impact lives globally, but you'll also benefit from a clear career progression path and a supportive environment that encourages mentorship and technical leadership. With a commitment to employee growth and the integration of AI in our development processes, Ideagen is the perfect place for those looking to make a meaningful impact while advancing their careers.
