At a Glance
- Tasks: Define quality standards for ML systems and automate QA workflows using Python.
- Company: Join Autodesk, a leader in innovative software solutions.
- Benefits: Competitive salary, remote work options, and a culture of collaboration.
- Other info: Dynamic environment with opportunities for growth and learning new technologies.
- Why this job: Make a real impact on cutting-edge ML projects while working with global teams.
- Qualifications: 7+ years in software engineering or QA for ML/AI systems, strong Python skills.
The predicted salary is between 60000 - 80000 £ per year.
As a Senior Machine Learning QA Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning Engineers and software engineers to define and uphold quality standards for ML systems. You are a quality-focused engineer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.
Responsibilities
- Define ML quality strategy and acceptance criteria across data, model, and system levels
- Design and maintain model evaluation suites, metrics, and test datasets
- Evaluating CAD RL model outputs for geometric validity or policy stability
- Defining structured rubrics that translate qualitative findings into measurable evaluation gates
- Testing ML Models from product side
- API Testing
- Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
- Create and maintain test harnesses for ML services and APIs
- Mentor teams on ML QA best practices and consistent evaluation standards
- Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
- Contribute to multi-team projects and codebases, ensuring code quality and consistency
- Participate in code reviews and provide constructive feedback to peers
- Document and present findings and ideas across the company
Minimum Qualifications
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience
- 7+ years of professional experience in software engineering or QA for ML/AI systems
- Strong programming skills in Python, with experience in test automation
- Familiarity with popular CAD environments tooling
- Proficient in Automation and UAT test suite/framework
- Experience designing QA frameworks or platforms used by multiple teams
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Understanding of software architecture and design patterns
- Ability to work in an agile development environment
Preferred Qualifications
- Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
- Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
- Experience with CI/CD tools and processes
- Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
- Familiarity with MLOps practices (model monitoring, drift, deployment checks)
- Experience with ML evaluation methods, metrics, and benchmarking
- Passion for learning new technologies and improving existing systems
- Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
- Experience testing ML services in production environments
- Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)
The Ideal Candidate
- You demonstrate initiative to provide solutions and to learn and develop new technologies
- Comfortable building QA systems from scratch and writing maintainable automation
- You enjoy learning and collaborating across global locations
- You are comfortable working in newly forming ambiguous areas
- You are comfortable building scalable and maintainable systems that will be relied on by others
- You can communicate well with others
Senior Machine Learning Test Engineer United Kingdom in London employer: Autodesk
At Autodesk, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to thrive. As a Senior Machine Learning Test Engineer, you will have the opportunity to work alongside talented professionals in a hybrid-first environment, allowing for flexibility between remote and office work. With a strong emphasis on employee growth, mentorship, and meaningful contributions to impactful projects, Autodesk is an excellent employer for those looking to shape the future of technology while enjoying a supportive and inclusive workplace.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Machine Learning Test Engineer United Kingdom in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those related to ML testing and automation. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common ML QA scenarios and coding challenges. Practice explaining your thought process clearly, as communication is key in collaborative environments like Autodesk.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team at Autodesk.
We think you need these skills to ace Senior Machine Learning Test Engineer United Kingdom in London
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter to highlight your experience with ML systems and QA practices. We want to see how your skills align with the role, so don’t hold back on showcasing relevant projects!
Show Off Your Technical Skills:Since this role is all about quality assurance in ML, be sure to mention your programming prowess in Python and any experience with automation tools. We love seeing candidates who can demonstrate their technical know-how!
Highlight Collaboration Experience:This position involves working closely with researchers and engineers, so share examples of how you’ve successfully collaborated in the past. We’re looking for team players who thrive in a hybrid environment!
Apply Through Our Website:Don’t forget to submit your application through our official website! It’s the best way for us to keep track of your application and ensure it gets the attention it deserves.
How to prepare for a job interview at Autodesk
✨Know Your ML Fundamentals
Brush up on your machine learning concepts, especially around model evaluation and testing. Be ready to discuss how you would define quality standards for ML systems and share examples of your past experiences in this area.
✨Showcase Your Automation Skills
Prepare to talk about your experience with test automation, particularly using Python. Highlight any CI/CD tools you've worked with, like GitHub Actions or Jenkins, and be ready to explain how you've automated workflows in previous roles.
✨Familiarise Yourself with CAD Tools
Since the role involves working with Autodesk CAD software, make sure you understand its basics. If you have experience with CAD environments, be prepared to discuss specific projects where you applied this knowledge.
✨Emphasise Collaboration and Communication
This position requires working closely with various teams. Think of examples that demonstrate your ability to collaborate effectively and communicate complex ideas clearly. Show that you're a team player who can mentor others on ML QA best practices.
