At a Glance
- Tasks: Lead quality assurance for AI models and design evaluation frameworks.
- Company: Mastek, a forward-thinking tech company with a flexible work culture.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Collaborate with top engineering teams and influence real-world AI applications.
- Why this job: Join us to shape the future of AI and ensure fairness in technology.
- Qualifications: 5+ years in QA/Software Engineering, with 2-3 years in AI/ML testing.
The predicted salary is between 60000 - 80000 £ per year.
We are looking for a Senior AI Model Tester to drive the quality, reliability, and performance of AI/ML systems across critical business use cases.
Key Responsibilities
- Lead AI model quality assurance, evaluation, and benchmarking strategy
- Design frameworks to evaluate accuracy, drift, bias, and performance under stress
- Define and track AI KPIs (precision, recall, LLM evaluation metrics)
- Build automated validation pipelines across lower environments and path-to-live
- Identify and mitigate bias, rogue outputs, and model disparities
- Develop synthetic datasets & test scenarios (including corrupt data handling)
- Establish data quality standards for fair AI outcomes
- Implement MLOps practices within CI/CD pipelines
- Collaborate closely with engineering and DevOps teams
Required Experience
- 5+ years in QA / Software Engineering / Automation Testing
- 2–3 years specifically in AI/ML model testing
- Strong expertise in Python / Java and statistical analysis
- Deep understanding of AI/ML lifecycle and evaluation frameworks
- Experience with tools like LangSmith, Fiddler, InspectAI, OpenAI Evals
- Strong SQL skills and experience with large-scale or unstructured datasets / vector DBs
Education
- Bachelor’s or Master’s in Data Science, Computer Science, Statistics, or related field
Why Join?
- Work on cutting-edge AI systems in real-world deployments
- Influence model governance, fairness, and performance standards
- Collaborate with high-impact engineering and AI teams
If you're passionate about ensuring AI systems are accurate, fair, and production-ready, we'd love to hear from you.
Senior AI Model Tester in Reading employer: Mastek
Mastek is an exceptional employer that values innovation and collaboration, particularly within the UK public sector. With a strong focus on employee growth, we offer competitive salaries, performance bonuses, and flexible working arrangements, allowing our team to thrive in a supportive remote environment. Join us in Leeds to be part of a dynamic culture that prioritises meaningful contributions and professional development.
