Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Build and maintain automated tests for cutting-edge AI systems and workflows.
- Company: Join a dynamic team at the forefront of conversational AI technology.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative environment with exciting projects and career advancement opportunities.
- Why this job: Make a real impact in AI by ensuring our systems are reliable and efficient.
- Qualifications: Experience in software test automation and strong problem-solving skills required.
The predicted salary is between 60000 - 80000 £ per year.
We are building real-time conversational AI systems powered by LLMs, ASR, and TTS. Our products evolve quickly, with new services, workflows, models, and customer-facing features constantly being developed. We are looking for an AI Reliability & Test Automation Engineer to work directly within the LLM AI team to build our automated test capability, helping our systems ship safely and confidently. This is an embedded engineering role focused on the craft of software testing in complex AI systems.
You will design and maintain automated test suites, regression checks, mocks, CI/CD test gates, and release validation processes across LLM-powered workflows, APIs, RAG systems, and conversational journeys. You will work closely with Machine Learning Engineers, Data Scientists, Backend Engineers, and external testing teams to ensure new features are testable from the start and changes can be evaluated quickly across the wider platform.
What you’ll do:
- Build and maintain automated unit, integration, API, and end-to-end test suites for LLM-powered services.
- Create regression test coverage for conversational workflows, RAG pipelines, prompt changes, model updates, and service-level behaviour.
- Develop test harnesses, mocks, fixtures, and tools that make it easier for engineers to validate new features and services.
- Integrate automated tests into CI/CD pipelines to provide fast, useful feedback during development and release.
- Work with MLEs, Data Scientists, and backend engineers to identify failure modes, edge cases, and high-risk product behaviours.
- Collaborate with external testing teams to connect manual/exploratory validation with automated engineering checks.
- Help improve testability across Python services by supporting better interfaces, dependency isolation, and observability.
- Support release confidence by creating clear automated checks for critical user journeys and system behaviours.
- Design load and stress testing frameworks for high-concurrency conversational AI systems.
- Use production telemetry and failure analysis to continuously evolve automated test coverage.
What we’re looking for:
- Experience in software test automation or SDET environments.
- Experience building automated API or backend testing frameworks.
- Experience integrating automated tests into CI/CD pipelines.
- Ability to think critically about system behaviour, edge cases, and failure modes.
- Strong debugging and problem-solving skills.
Nice to have:
- Understanding of modern AI systems, LLMs, or conversational AI products.
- Experience in fast-paced, high scale SaaS environments and building tests for rapid development cycles.
- Understanding of how to test distributed, asynchronous, or non-deterministic systems.
- Comfortable working collaboratively, cross-functionally with research and engineering teams.
Backgrounds that fit well:
- SDET or QA Automation Engineers with strong Python and backend testing experience.
- Backend Software Engineers who have a strong preference for building internal tooling, CI/CD, and testing frameworks.
- Automation engineers from fast-paced, high-scale SaaS environments who know how to build test automation that keeps up with rapid development cycles.
AI Reliability & Test Automation Engineer in Manchester employer: ConnexAI
Contact Detail:
ConnexAI Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land AI Reliability & Test Automation Engineer in Manchester
✨Tip Number 1
Network like a pro! Reach out to folks in the AI and software testing communities on LinkedIn or at meetups. We can’t stress enough how valuable personal connections can be in landing that dream job.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your automated test frameworks or any projects you've worked on. This gives potential employers a taste of what you can do, especially in complex AI systems.
✨Tip Number 3
Prepare for those interviews! Brush up on your debugging and problem-solving skills, and be ready to discuss your experience with CI/CD pipelines. We want to see how you think critically about system behaviour.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are genuinely interested in joining our team.
We think you need these skills to ace AI Reliability & Test Automation Engineer in Manchester
Some tips for your application 🫡
Tailor Your CV: Make sure your CV reflects the skills and experiences that match the job description. Highlight your experience in software test automation, especially with Python and backend testing frameworks, as this is key for us.
Craft a Compelling Cover Letter: Use your cover letter to tell us why you're passionate about AI and how your background fits into our fast-paced environment. Share specific examples of your work in automated testing and CI/CD pipelines to grab our attention.
Showcase Your Problem-Solving Skills: In your application, don’t shy away from discussing challenges you've faced in previous roles. We love candidates who can think critically about system behaviour and have strong debugging skills, so share those stories!
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows us you’re keen on joining our team!
How to prepare for a job interview at ConnexAI
✨Know Your Tech Inside Out
Make sure you’re well-versed in the technologies mentioned in the job description, especially around automated testing frameworks and CI/CD pipelines. Brush up on your Python skills and be ready to discuss how you've implemented test automation in previous roles.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled complex testing challenges in AI systems or similar environments. Be ready to explain your thought process when identifying failure modes and edge cases, as this will demonstrate your critical thinking abilities.
✨Collaborate Like a Pro
Since this role involves working closely with various teams, think of instances where you’ve successfully collaborated with engineers or data scientists. Highlight your experience in cross-functional teamwork and how it led to improved testing processes or product outcomes.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s approach to testing and quality assurance in their AI products. This shows your genuine interest in the role and helps you gauge if the company culture aligns with your values, especially regarding innovation and collaboration.