At a Glance
- Tasks: Lead testing and quality assurance for AI systems in a dynamic environment.
- Company: Join a forward-thinking financial services company focused on AI-driven transformation.
- Benefits: Enjoy 25 days holiday, bonuses, pension contributions, and comprehensive health benefits.
- Other info: Hybrid role with opportunities for professional growth and development.
- Why this job: Make a real impact in AI testing while collaborating with diverse teams.
- Qualifications: Experience in testing complex systems and knowledge of AI technologies required.
The predicted salary is between 60000 - 75000 € per year.
Are you passionate about making a difference, using your skills & experience to be a key enabler of AI-driven transformation? If so, we may have the role for you! We are excited to share an incredible opportunity for an AI Test Lead to join our team in Data & AI. As our newest AI Test Lead, you will be responsible for defining and leading testing and quality assurance practices for AI-enabled systems and solutions. This is a hybrid role with working from home plus some onsite presence in our Bradford & central Leeds offices.
About the role
The role addresses the unique challenges of testing AI systems, including probabilistic behaviour, variability in outputs, and responsible AI considerations. Through robust testing frameworks and collaboration with delivery and governance teams, the role supports compliant and trustworthy deployment of AI solutions within a regulated financial services environment.
- Develop AI testing frameworks and methodologies that account for non‑deterministic behaviour, probabilistic outputs, and variability in AI responses.
- Embed responsible AI and risk testing by defining test cases that assess bias, fairness, transparency, safety, and the effectiveness of AI guardrails.
- Implement automated AI testing capabilities by developing test automation and integrating testing activities into DevOps and MLOps pipelines.
- Collaborate across delivery and governance teams to ensure testing practices align with engineering standards, regulatory expectations, and enterprise assurance requirements.
About You
You will have:
- Strong experience in testing and quality assurance for complex systems.
- Working knowledge of AI and machine learning technologies, including large language models and Retrieval‑Augmented Generation (RAG).
- Familiarity with test automation, DevOps pipelines, and MLOps practices.
- Experience working with Microsoft Azure, Azure AI services, and Copilot‑based solutions.
- Strong collaboration and communication skills, including engagement with non‑technical stakeholders.
Benefits
We offer lots of fantastic rewards that you can make the most of in and out of work, including:
- Holiday: You’ll get 25 days plus Bank Holidays, as well as the option to buy up to a further 5 days.
- Bonus: At YBS we work collaboratively and share in our success together, so when we reach our goals we are all rewarded with an on target bonus of 7% of eligible pay (with the opportunity to earn up to a maximum 15%).
- Pension: We know how important it is to save towards the future, that’s why we’ll contribute up to 11% into your YBS pension.
- Healthcare: Health and wellbeing are an important part of life at YBS, when you join us you’ll have access to a range of health benefits to suit your life including private medical insurance, dental and healthcare plans.
- My Benefits: When you join YBS you’ll have access to our self‑service benefits portal, where you can access a range of retail, hospitality and health discounts.
Please note: This advert will close 3rd June. If you have any questions about this role, please contact careers@ybs.co.uk.
AI Test Lead in Leeds employer: Yorkshire Building Society
At YBS, we pride ourselves on being an exceptional employer that fosters a collaborative and innovative work culture. As an AI Test Lead in our Bradford & central Leeds offices, you will benefit from a generous holiday allowance, a competitive bonus structure, and comprehensive health benefits, all while working in a hybrid environment that promotes work-life balance. We are committed to your professional growth, offering opportunities to develop cutting-edge testing frameworks in the rapidly evolving field of AI, ensuring you play a pivotal role in shaping responsible AI solutions within the financial services sector.
StudySmarter Expert Advice🤫
We think this is how you could land AI Test Lead in Leeds
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your testing frameworks and methodologies. This is a great way to demonstrate your expertise in AI testing and make a lasting impression.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of AI and machine learning technologies. Be ready to discuss how you've tackled challenges in testing complex systems and how you ensure responsible AI practices.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are genuinely interested in joining our team.
We think you need these skills to ace AI Test Lead in Leeds
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter to highlight your experience in testing AI systems. We want to see how your skills align with the unique challenges mentioned in the job description.
Showcase Your Technical Skills:Don’t forget to mention your familiarity with AI technologies, test automation, and DevOps practices. We’re looking for someone who can hit the ground running, so let us know what tools you’ve worked with!
Highlight Collaboration Experience:Since this role involves working with various teams, share examples of how you've successfully collaborated with both technical and non-technical stakeholders. We value strong communication skills!
Apply Through Our Website:For the best chance of success, make sure to apply directly through our website. It’s the easiest way for us to review your application and get you on board for an exciting journey with StudySmarter!
How to prepare for a job interview at Yorkshire Building Society
✨Know Your AI Stuff
Make sure you brush up on your knowledge of AI and machine learning technologies, especially large language models and Retrieval-Augmented Generation (RAG). Be ready to discuss how these technologies impact testing and quality assurance, as this will show your passion and expertise in the field.
✨Showcase Your Testing Frameworks
Prepare to talk about your experience in developing testing frameworks for complex systems. Highlight any specific methodologies you've used that address non-deterministic behaviour and probabilistic outputs. This will demonstrate your ability to tackle the unique challenges of testing AI systems.
✨Collaboration is Key
Since the role involves working with delivery and governance teams, be ready to share examples of how you've successfully collaborated with both technical and non-technical stakeholders. This will showcase your strong communication skills and your ability to align testing practices with engineering standards.
✨Automate Your Success
Discuss your experience with test automation and integrating testing activities into DevOps and MLOps pipelines. If you have specific examples of how you've implemented automated testing capabilities, make sure to highlight those. This will show that you're not just familiar with the concepts but have practical experience applying them.
