At a Glance
- Tasks: Build and maintain AI evaluation systems for genomic datasets.
- Company: Join a pioneering company in bioinformatics and AI technology.
- Benefits: Competitive salary, flexible work options, and opportunities for growth.
- Other info: Dynamic team environment with a focus on innovation and collaboration.
- Why this job: Make a real impact in AI and genomics while working with cutting-edge technology.
- Qualifications: Degree in Bioinformatics or related field; experience with genomic datasets required.
The predicted salary is between 50000 - 70000 £ per year.
The Position
At Sequencing, you'll build and operate the evaluation and validation infrastructure that keeps our AI systems correct, reliable, and regression-protected. This is an execution-focused role: you'll design, implement, and maintain the benchmarking systems that continuously test AI outputs against curated genomic datasets, partnering closely with the AI Bioinformatics Engineering Lead to turn interpretation standards into measurable, operational systems. You are detail-oriented, have a systems-thinking mindset and you notice the one VCF out of ten thousand that doesn't look right.
The Opportunity
- Build and run automated evaluation pipelines for AI outputs end-to-end.
- Expand regression datasets that cover variant normalization, transcript ambiguity, and disease-level mapping.
- Execute large-scale validation runs across curated VCF datasets, track performance over time, and surface accuracy regressions the moment they appear.
- Grow a structured question bank using and related datasets, encoding the edge cases that matter most.
- Ship automated regression tests for every AI release and build dashboards that make variant-level and case-level accuracy visible to the whole team.
- Partner with engineering to wire validation directly into CI/CD, and diagnose and document failure modes as they emerge.
Who you are
- Degree in Bioinformatics, Computational Biology, Genetics, or a related field.
- Deep, hands-on experience with VCFs and real-world genomic datasets.
- Fluency with ClinVar, dbSNP, HGVS standards, and transcript mapping.
- A track record building evaluation frameworks or testing pipelines, Langfuse or similar.
- Experience evaluating LLM-based systems and standing up automated QA at scale.
AI Bioinformatics Benchmarking Engineer employer: Caraa
At Sequencing, we pride ourselves on fostering a collaborative and innovative work environment where our employees can thrive. As an AI Bioinformatics Benchmarking Engineer, you will have the opportunity to work with cutting-edge technology in a dynamic team that values detail-oriented problem-solving and continuous learning. Our commitment to employee growth is reflected in our structured development programmes and the chance to make a meaningful impact in the field of genomics.
