Quality Assurance Engineer (Automation) in London

This is a hands on engineering job focused on automated testing, not manual checking. A strong candidate writes test code in TypeScript and Python, keeps Playwright and API suites fast and reliable, and can judge whether AI model output is accurate enough for clinicians. The role also owns the final release decision, so clear evidence based judgement matters as much as coding skill.How it fits the AI eraThe product itself is an AI scribe, so the work sits close to model output that changes from run to run. Much of the testing craft stays human: deciding what counts as correct clinical output, designing evaluations when exact matches fail, and making the call on whether a release is safe. AI tools speed up test writing and monitoring, but the judgement about clinical trust remains with the engineer.How it builds AI experienceThe role offers direct practice in evaluating large language model output using tools like DeepEval, openevals and Langfuse traces, which is a rare and growing skill. Building this means learning to design evaluations for non deterministic responses and reading traces to spot where output drifts. Experience with contract tests and load testing adds a solid base for testing AI features in a clinical product.Worth showingTypeScript and Python testingAPI contract testing OpenAPICI pipelines and DockerThis is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.About Lyrebird HealthAn AI scribe built directly into Australia's most-used GP software, auto-filling care plans from the consultation rather than just writing a note.