Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Define and implement assurance strategies for AI systems, ensuring reliability and security.
- Company: Join Resillion, a leader in total quality services with a culture of responsibility and innovation.
- Benefits: Competitive salary of £85K, flexible remote work, and opportunities for professional growth.
- Why this job: Be at the forefront of AI technology and make a real impact on quality assurance.
- Qualifications: Strong software engineering skills, experience in automation, and understanding of AI systems.
- Other info: Dynamic work environment in Glasgow with a focus on personal development and teamwork.
The predicted salary is between 68000 - 102000 £ per year.
Help us to achieve our goal to be the global leader in total quality services. With your help we will achieve this by delivering Total Quality 360, a comprehensive suite of cutting-edge services which combine quality engineering, cyber security, conformance & interoperability and content quality to deliver end-to-end total quality solutions. Here at Resillion, our culture is based on an ‘if you see something, say something’ attitude where we take responsibility. It’s one where we expect to adapt and embrace change as the company grows. It’s based on recognising the individual worth of every one of our employees and developing their skills to keep us all at the forefront of our industry. Above all, it’s a culture where we’re passionate about what we do, and we’re committed to the greater good of the company. If you would like to be part of our journey, then this role may be the one for you.
We are seeking an SDET - Test Automation AI (Agentic & LLM Systems) to define and implement assurance approaches for AI-enabled systems. The role focuses on ensuring that AI solutions are reliable, robust, explainable, secure, and fit for purpose across their full lifecycle. The AI Assurance Engineer will assure both:
- Probabilistic components (data, models, and AI outputs)
- Deterministic components (software, integrations, and infrastructure)
and will embed assurance into automated, end-to-end delivery pipelines. This role requires a strong understanding of how to assure AI systems holistically, rather than deep specialism in a single discipline.
Key Responsibilities
- AI Assurance Strategy
- Define and implement an AI assurance approach aligned to business risk and regulatory expectations.
- Provide assurance coverage across the full AI system lifecycle (design, build, deploy, operate).
- Work with engineering, data, and product teams to embed quality and risk controls early.
- Probabilistic Component Assurance
- Design validation approaches for:
- Data quality and bias
- Model and prompt behaviour
- Output accuracy, relevance, and consistency
- Implement evaluation methods for:
- Drift and instability
- Hallucination and error patterns
- Assure non-AI system elements including:
- Application logic and workflows
- APIs and integrations
- Security and access controls
- Functional testing
- Non-functional testing (performance, resilience, scalability)
- Security and data protection validation
- Design & build automated assurance for AI systems.
- Integrate assurance into CI/CD and deployment pipelines.
- Implement regression and quality gates across data, models, and orchestration workflows.
- Maintain an end-to-end assurance pipeline from input data through to system outputs.
- Support monitoring and observability for AI-enabled systems in production.
- Analyse operational signals such as:
- Latency and failures
- Behaviour changes
- Performance degradation
- Define and track AI quality and risk metrics (accuracy, robustness, explainability).
- Support compliance with:
- Data protection and privacy requirements
- Responsible AI principles
Required Skills & Experience
- Core
- Strong software engineering background (Python or similar).
- Experience building automated test or validation frameworks.
- Experience working with complex distributed or cloud-based systems.
- AI & Probabilistic Systems
- Understanding of:
- Data quality and bias
- Model behaviour and non-deterministic outputs
- Prompt-based or agent-based systems
- Experience validating correctness, consistency, and relevance of AI outputs.
- Experience testing:
- APIs and workflows
- Cloud services
- Performance testing
- Security testing
- Resilience and failure handling
- Familiarity with:
- Model lifecycle management
- CI/CD for AI systems
- Monitoring and drift detection
SDET - Test Automation AI (Agentic & LLM Systems) - Perm - Circa £85K - 2 days a week in Glasgow employer: Resillion
Contact Detail:
Resillion Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land SDET - Test Automation AI (Agentic & LLM Systems) - Perm - Circa £85K - 2 days a week in Glasgow
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Prepare for those interviews by practising common questions and scenarios related to SDET roles. We recommend doing mock interviews with friends or using online platforms to get comfortable with your responses.
✨Tip Number 3
Showcase your skills! Create a portfolio or GitHub repository that highlights your projects, especially those involving AI and automation. This gives potential employers a tangible look at what you can do.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace SDET - Test Automation AI (Agentic & LLM Systems) - Perm - Circa £85K - 2 days a week in Glasgow
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the SDET role. Highlight your experience with AI systems, automation, and any relevant projects you've worked on. We want to see how your skills align with our mission at Resillion!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Share your passion for quality assurance in AI and how you can contribute to our Total Quality 360 vision. Let us know why you're excited about this opportunity!
Showcase Your Technical Skills: Don’t forget to highlight your technical skills, especially in Python or similar languages. Mention any frameworks you've built for automated testing and your experience with cloud-based systems. We love seeing your expertise in action!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at Resillion
✨Know Your AI Systems
Make sure you brush up on your understanding of AI systems, especially around data quality, model behaviour, and validation methods. Be ready to discuss how you would approach assurance for both probabilistic and deterministic components.
✨Showcase Your Automation Skills
Prepare to talk about your experience with building automated test frameworks. Highlight specific projects where you've integrated assurance into CI/CD pipelines, as this will demonstrate your hands-on expertise in automation.
✨Understand the Bigger Picture
Familiarise yourself with the full lifecycle of AI systems, from design to deployment. Be prepared to discuss how you would embed quality and risk controls early in the process, showing that you can think strategically about assurance.
✨Be Ready for Technical Questions
Expect technical questions related to software engineering, particularly in Python or similar languages. Brush up on your knowledge of APIs, cloud services, and non-functional testing, as these are crucial for the role.
