At a Glance
- Tasks: Design and build automation frameworks for testing AI systems using Python.
- Company: Join Resillion, a passionate tech company leading in AI innovation.
- Benefits: Flexible hybrid work, competitive salary, and skill development opportunities.
- Other info: Dynamic environment with opportunities for career growth in AI.
- Why this job: Be at the forefront of AI technology and make a real impact.
- Qualifications: Strong Python skills and experience in test automation required.
The predicted salary is between 55000 - 70000 £ per year.
At Resillion, our culture is built on a mindset of “if you see something, say something” — taking responsibility and speaking up. We expect everyone to adapt and embrace change as the company grows. We recognise the value of every employee and invest in developing their skills so that, as an organisation, we continue to lead our industry. Above all, it’s a culture driven by passion for what we do and commitment to the bigger picture of the company. If you want to be part of our journey, this role may be the right fit for you.
Location: Glasgow (Hybrid preferred but not essential)
Start Date: Immediate
Right to Work: Must have full UK working rights (no sponsorship available due to start dates)
Additional Requirement: Must have 3 years of UK address history due to immediate onboarding
Programme: AI / Agentic AI
Seniority: Senior Automation Engineer
Overview
We are seeking a Senior Automation Engineer / SDET with strong Python skills and hands‑on experience testing AI systems, including LLM‑driven applications and agentic AI workflows. You will design and build a scalable automation framework, implement modern AI testing strategies, and ensure the quality and reliability of next‑generation conversational and agent‑based AI products. This role is ideal for someone who is passionate about automation engineering and has a solid understanding of how AI/LLM systems behave in real‑world scenarios.
Key Responsibilities
- Develop and maintain a Python‑based automation framework for validating AI agents (chatbots, voicebots, agentic workflows).
- Design and execute automated tests for:
- LLM responses
- Conversational flows
- Retrieval‑augmented generation (RAG)
- End‑to‑end agentic scenarios
- Apply modern AI testing strategies and evaluation methods (e.g., DeepEval, RAGAS — beneficial but not essential).
- Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, Azure Repos).
- Build and manage batch and scheduled executions using Docker, Kubernetes, cron jobs, or similar tooling.
- Manage code repositories using Git, including branching strategies, version control, and collaborative workflows.
- Collaborate closely with engineering, AI/ML, and product teams to ensure high‑quality delivery of AI‑powered features.
Required Skills & Experience
- Strong Python development skills, particularly for automation (PyTest preferred).
- Solid background in test automation and framework design.
- Experience testing or validating AI/LLM‑based systems (agentic workflows, conversational AI, RAG pipelines, etc.).
- Understanding of AI evaluation concepts — familiarity with tools like DeepEval or RAGAS is a bonus, not a requirement.
- Experience implementing CI/CD pipelines and automated batch executions.
- Strong understanding of source code management, Git workflows, and collaborative engineering practices.
- Ability to design structured, scalable, and maintainable automation solutions.
Preferred Qualities
- Quick learner with a proactive, ownership‑driven mindset.
- Strong problem‑solving skills and ability to work in fast‑moving AI environments.
- Comfortable collaborating with cross‑functional teams (AI/ML, engineering, product).
- Passion for AI technologies and modern testing methodologies.
Senior Python Automation Tester for AI & LLM Systems in Glasgow employer: Resillion Group
At Resillion, we pride ourselves on fostering a dynamic and inclusive work culture that encourages innovation and personal growth. As a Senior Python Automation Tester in our Glasgow office, you will not only contribute to cutting-edge AI technologies but also benefit from our commitment to employee development and a collaborative environment. With flexible hybrid working options and a focus on continuous learning, Resillion is the perfect place for passionate professionals looking to make a meaningful impact in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Python Automation Tester for AI & LLM Systems in Glasgow
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those working with AI and automation. Attend meetups or webinars, and don’t be shy about sliding into DMs on LinkedIn. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a GitHub repository showcasing your Python automation projects, especially those related to AI testing. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common automation testing scenarios, especially in AI contexts. Practice explaining your thought process and how you tackle challenges. We want to see your passion for automation shine through!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive and engaged with our company. Let’s get you on board!
We think you need these skills to ace Senior Python Automation Tester for AI & LLM Systems in Glasgow
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Senior Python Automation Tester role. Highlight your experience with AI systems and Python automation, as well as any relevant projects you've worked on. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to express your passion for automation testing and AI technologies. Share specific examples of your work that demonstrate your problem-solving skills and ability to adapt in fast-paced environments. Let us know why you're excited about joining our team!
Showcase Your Projects:If you've worked on any projects related to AI or LLM systems, make sure to mention them! Whether it's a personal project or something from a previous job, we love seeing practical applications of your skills. Include links or descriptions that highlight your contributions.
Apply Through Our Website:We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of applications and ensures you’re considered for the role. Plus, it’s super easy to do – just follow the prompts and submit your application!
How to prepare for a job interview at Resillion Group
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially around automation frameworks like PyTest. Be ready to discuss your past projects and how you've used Python to solve real-world problems in AI testing.
✨Familiarise Yourself with AI Testing Strategies
Since the role involves testing AI systems, it’s crucial to understand modern AI testing strategies. Even if you’re not familiar with tools like DeepEval or RAGAS, showing a willingness to learn about them can set you apart.
✨Showcase Your Collaborative Spirit
Resillion values teamwork, so be prepared to share examples of how you've worked with cross-functional teams in the past. Highlight your communication skills and how you’ve contributed to successful project outcomes.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving abilities in fast-paced environments. Think of specific scenarios where you had to adapt quickly or overcome challenges in automation testing, particularly in AI contexts.
