At a Glance
- Tasks: Ensure high-quality AI solutions through rigorous testing and collaboration with engineering teams.
- Company: Join R/GA's innovative applied intelligence studio, shaping the future of AI.
- Benefits: Competitive salary, hybrid work model, and direct access to leadership.
- Other info: Dynamic environment with opportunities for growth and collaboration across diverse teams.
- Why this job: Lead impactful projects at the forefront of AI innovation and redefine global brand operations.
- Qualifications: 4+ years in software QA, with experience in AI systems and strong problem-solving skills.
The predicted salary is between 72000 - 88000 £ per year.
About Addition
Addition is R/GA's applied intelligence studio. We work with many of the world's leading brands to solve problems at the intersection of frontier AI and human-centered design. We collaborate with our clients to implement and scale AI systems that create real-world value—improving communications, customer experiences, and internal business workflows.
About the Role
As our Senior AI Quality Engineer, your job is to ensure that the solutions we ship are high quality by methodically testing them and working with engineering to implement improvements. This requires a test and verify mindset; you don’t assume things are working, you understand the shape of the system and test it from every angle to ensure quality. During planning phases, you explore system architecture, write test plans, and align with the team on what “quality” looks like. As systems are built, you red-team them, code scripts to automate and scale testing processes, implement logging, and methodically analyze the results. You think like an AI agent, stress-testing the behaviour of AI systems under a wide range of conditions beyond the happy-path.
This is a new role at Addition, created because the complexity of the AI systems we ship has outgrown traditional QA practices and ad-hoc evaluation. We need someone who turns quality into a new discipline for the AI systems era — evolving fuzzy notions of “quality” into measurable signals, and bringing the rigor of a structured adversarial mindset. This role sits within our engineering team, working closely with engineers, PMs, cross-functional project teams, and clients.
Primary Responsibilities
- Test Planning: During project planning phases, translate product and technical requirements into structured test plans — covering functional behaviour, edge cases, failure modes, and AI-specific risks like hallucination, prompt injection, and output drift.
- Agentic Testing: Working with coding agents like Claude Code and local or online versions of AI System builds to write test scripts, setup logging frameworks, analyse agent behaviour, user behaviour, to identify points of failure and opportunities for improvement.
- AI Red Teaming: When systems are built, systematically red-team them before launch. Probe LLM behaviours, agent decision chains, brand voice outputs, and multi-model pipelines for failure modes that functional testing won't surface.
- Launch Gating: Act as the quality gate on launches — raising blockers, documenting failure cases, and holding the line on ship criteria.
- Regression & Evaluation Frameworks: Build and maintain lightweight eval frameworks and test harnesses for recurring system types to systematize and improve efficiency, speed and cost of QA and red teaming practices over time.
- Cross-Project Quality Standards: Work across our project portfolio to develop shared quality standards for AI systems — what “good enough to ship” actually means for agentic products.
- Tracing and Documentation: Document failure patterns, red team findings, and test results in a form that engineers and PMs can act on.
The Ideal Person
- Problem Solver & Adaptable: Thrives in fast-paced, high-ambiguity environments and turns complex challenges into structured, elegant solutions.
- High EQ & Collaborative: A cross-functional team player who builds strong, trusting relationships with internal teams, C-suite executives, and enterprise clients.
- Authentic Communicator: Exceptional written and verbal communication skills, able to translate complex technical/AI concepts into clear, actionable, and persuasive ideas.
- Curious & Forward-Thinking: Genuinely passionate about frontier AI, continuous learning, and exploring applied innovation.
Requirements
- Experience: 4+ years of software QA, test engineering, or quality engineering experience, with at least 1–2 years working on AI-powered or LLM-based systems.
- Technical & Industry Literacy: Deep familiarity with failure modes specific to generative AI systems.
- Execution & Track Record: Hands-on fluency with AI development tools, agent frameworks, and prompt engineering.
- Tooling Proficiency: Comfort operating with modern collaboration tools.
Bonus Points
- Background working in an agency, studio, or consultancy where projects run fast and quality standards need to travel across diverse client work.
- Experience red-teaming production AI agents.
- Prior work in brand safety, content moderation, or AI safety adjacent to production systems.
Why Join Addition?
- Shape the Future: Lead and innovate at an AI-powered studio at the forefront of applied AI innovation.
- High-Impact Work: Build and drive technological and creative solutions that redefine how global brands operate.
- Direct Leadership Access: Collaborate closely with our CEO, leadership team, and R/GA network to help define how we scale.
This role is based in the NYC / Tri-State area, Greater Los Angeles area, or San Francisco Bay Area. Candidates must be located within commuting distance in the Tri-State area (NY, NJ, CT), Southern California, or the Bay Area, or willing to relocate. This position offers a hybrid work model, with regular in-person collaboration and team / client workshops.
The hiring range for this position is $135,000 to $150,000.
Senior AI Quality Engineer employer: R/GA
R/GA is an exceptional employer that fosters a dynamic and innovative work culture, where creativity and technology converge to drive meaningful impact. As the Executive Director, Growth, you will enjoy unparalleled opportunities for professional development while collaborating with top-tier talent in a vibrant London setting. With a focus on strategic growth and a commitment to nurturing your career, R/GA empowers you to shape the future of brand experiences in a supportive and forward-thinking environment.
StudySmarter Expert Advice🤫
We think this is how you could land Senior AI Quality Engineer
✨Join Local Tech Meetups
Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at R/GA or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!
✨Contribute to Open Source Projects
Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to R/GA.
✨Tap into Online Developer Communities
Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like R/GA.
✨Explore Job Boards Specifically for Tech Roles
Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like R/GA that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!
We think you need these skills to ace Senior AI Quality Engineer
Some tips for your application 🫡
Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.
Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at R/GA.
Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at R/GA and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!
Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!
How to prepare for a job interview at R/GA
✨Brush Up on Your Coding Skills
For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.
✨Know Your Tools and Frameworks
Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If R/GA uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.
✨Showcase Your Projects
Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.
✨Prepare for Behavioural Questions
While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.