Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Ensure quality and security of AI services through testing and collaboration.
- Company: Avensys Consulting UK, a leader in AI and cloud technology.
- Benefits: Competitive salary, remote work options, and opportunities for professional growth.
- Other info: Mentorship opportunities and a culture of continuous innovation.
- Why this job: Join a dynamic team to shape the future of ethical AI services.
- Qualifications: Experience in software testing and a passion for AI technologies.
The predicted salary is between 36000 - 60000 £ per year.
Join to apply for the AI Test Engineer – AI/ML role at Avensys Consulting UK
We are looking for a detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services.
You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities. This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale.
You’ll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools – with a builder mindset – rapid prototyping and continuous improvement with agility of a start-up
Key Responsibilities
- Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure.
- Design and implement automated test suites for APIs, service components, and AI pipelines.
- Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses.
- Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks.
- Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes.
- Participate in threat modelling and security validation of exposed APIs and AI services.
- Provide feedback early in the lifecycle to reduce defects and improve design.
- Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation.
Requirements
- AI & Cloud Expertise
- Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.
- Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection.
- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations
- Defining Performance Metrics for AI services and testing for the same
- Awareness of AI safety, bias detection, and explainability techniques.
- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
- Strong belief in ethical AI practices, transparency, and end-user trust.
Core Skills And Qualifications
- 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.
- Proficient in designing automated testing frameworks
- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments.
- Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10).
- Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions.
- Experience working in Agile teams and collaborating across global R&D locations
- Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
#J-18808-Ljbffr
AI Test Engineer - AI/ML employer: Avensys Consulting UK
Contact Detail:
Avensys Consulting UK Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land AI Test Engineer - AI/ML
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Prepare for those interviews by practising common questions and scenarios related to AI testing. Get comfy discussing your experience with cloud-native services and automated testing frameworks – it’ll show you’re ready to hit the ground running!
✨Tip Number 3
Showcase your skills through a portfolio or GitHub. Share projects that highlight your expertise in AI validation techniques and automated testing. This gives potential employers a tangible look at what you can bring to the table.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace AI Test Engineer - AI/ML
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the AI Test Engineer role. Highlight your experience with cloud-native applications, automated testing frameworks, and any relevant AI expertise. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about AI testing and how your background makes you a great fit for our team. Don’t forget to mention your understanding of ethical AI practices and compliance with regulations.
Showcase Your Technical Skills: In your application, be sure to showcase your technical skills, especially in areas like API testing, performance profiling, and security testing. We love candidates who can demonstrate their hands-on experience with Azure DevOps and CI/CD pipelines!
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It’s super easy, and you’ll be able to submit all your materials in one go. Plus, we love seeing applications come directly from our site!
How to prepare for a job interview at Avensys Consulting UK
✨Know Your AI Inside Out
Make sure you brush up on your knowledge of AI concepts, especially those mentioned in the job description like LLM evaluation techniques and prompt engineering. Being able to discuss these topics confidently will show that you're not just familiar with the theory but can apply it practically.
✨Showcase Your Testing Skills
Prepare to talk about your experience with automated testing frameworks and API testing. Have specific examples ready that demonstrate how you've designed test suites or validated cloud-native services. This will help the interviewers see your hands-on expertise in action.
✨Emphasise Collaboration
Since this role involves working closely with developers and data scientists, be ready to discuss how you've collaborated in past projects. Share examples of how you provided feedback early in the lifecycle to improve designs and reduce defects. This shows you’re a team player who values communication.
✨Be Ethical and Forward-Thinking
Given the focus on ethical AI practices, come prepared to discuss your views on AI safety, bias detection, and compliance with regulations. Showing that you care about these issues will resonate well with the company’s values and demonstrate your commitment to responsible AI development.