At a Glance
- Tasks: Define quality standards for ML systems and automate QA workflows using Python.
- Company: Join a leading tech company focused on innovative machine learning solutions.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Dynamic team environment with a focus on learning and development.
- Why this job: Make a real impact in the ML field while collaborating with top researchers and engineers.
- Qualifications: 7+ years in software engineering or QA for ML/AI systems, strong Python skills required.
The predicted salary is between 70000 - 90000 £ per year.
As a Senior Machine Learning QA Engineer in the Research Enablement team, you will work side‑by‑side with researchers, Machine Learning Engineers and software engineers to define and uphold quality standards for ML systems. You are a quality‑focused engineer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.
Responsibilities
- Define ML quality strategy and acceptance criteria across data, model, and system levels
- Design and maintain model evaluation suites, metrics, and test datasets
- Evaluate CAD RL model outputs for geometric validity or policy stability
- Define structured rubrics that translate qualitative findings into measurable evaluation gates
- Test ML Models from product side API Testing
- Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
- Create and maintain test harnesses for ML services and APIs
- Mentor teams on ML QA best practices and consistent evaluation standards
- Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
- Contribute to multi‑team projects and codebases, ensuring code quality and consistency
- Participate in code reviews and provide constructive feedback to peers
- Document and present findings and ideas across the company
Qualifications
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience
- 7+ years of professional experience in software engineering or QA for ML/AI systems
- Strong programming skills in Python, with experience in test automation
- Familiarity with popular CAD environments tooling
- Proficient in Automation and UAT test suite/framework
- Experience designing QA frameworks or platforms used by multiple teams
- Excellent problem‑solving skills and attention to detail
- Strong communication and collaboration skills
- Understanding of software architecture and design patterns
- Ability to work in an agile development environment, experience with data validation tooling (e.g., Great Expectations) or labeling workflows
- Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
- Experience with CI/CD tools and processes
- Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
- Familiarity with MLOps practices (model monitoring, drift, deployment checks)
- Experience with ML evaluation methods, metrics, and benchmarking
- Passion for learning new technologies and improving existing systems
- Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
- Experience testing ML services in production environments
- Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)
Ideal Candidate
- Demonstrate initiative to provide solutions and to learn and develop new technologies
- Comfortable building QA systems from scratch and writing maintainable automation
- Enjoy learning and collaborating across global locations
- Comfortable working in newly forming ambiguous areas
- Comfortable building scalable and maintainable systems that will be relied on by others
- Can communicate well with others
Senior Machine Learning Test Engineer United Kingdom in Newtown employer: Autodesk
As a Senior Machine Learning Test Engineer in the United Kingdom, you will join a dynamic and innovative team that values quality and collaboration. Our work culture fosters continuous learning and growth, providing ample opportunities for professional development while working on cutting-edge ML technologies. With a focus on mentorship and cross-team collaboration, we ensure that our employees thrive in an environment that encourages creativity and excellence.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Machine Learning Test Engineer United Kingdom in Newtown
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those related to ML testing and automation. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common ML QA scenarios and challenges. Practice explaining your thought process and how you approach problem-solving, as this will demonstrate your expertise and passion for the field.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are genuinely interested in joining our team.
We think you need these skills to ace Senior Machine Learning Test Engineer United Kingdom in Newtown
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the job description. Highlight your experience in ML QA, automation, and any relevant programming skills, especially in Python. We want to see how you fit into our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about quality assurance in ML systems and how your background makes you a great fit for our Research Enablement team. Keep it engaging and personal!
Showcase Your Projects:If you've worked on any relevant projects, whether in a professional or personal capacity, make sure to mention them. We love seeing practical examples of your work, especially if they involve test automation or ML evaluation methods.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets to us quickly and efficiently. Plus, it shows you're keen on joining the StudySmarter family!
How to prepare for a job interview at Autodesk
✨Know Your ML Inside Out
Make sure you brush up on your machine learning concepts, especially around evaluation methods and metrics. Be ready to discuss how you would define quality standards for ML systems and share examples from your past experiences.
✨Showcase Your Automation Skills
Prepare to talk about your experience with test automation, particularly in Python. Have specific examples ready where you've automated QA workflows or built test harnesses, and be prepared to discuss the tools you used, like CI/CD processes.
✨Familiarity with CAD Tools is Key
Since the role involves evaluating CAD RL model outputs, make sure you’re comfortable discussing Autodesk CAD software. If you have any projects or experiences related to CAD, bring those up during the interview to demonstrate your hands-on knowledge.
✨Collaboration is Crucial
This role requires working closely with various teams, so be ready to share examples of how you've successfully collaborated in the past. Highlight your communication skills and any mentoring experiences, as these will show your ability to contribute positively to team dynamics.
