At a Glance
- Tasks: Define quality standards for ML systems and automate QA workflows using Python.
- Company: Join Autodesk, a global leader in design software with a hybrid-first culture.
- Benefits: Competitive salary, bonuses, stock options, and comprehensive benefits package.
- Other info: Dynamic environment with opportunities for learning and career growth.
- Why this job: Make an impact on cutting-edge ML projects while collaborating with top talent.
- Qualifications: 7+ years in software engineering or QA for ML/AI systems, strong Python skills.
The predicted salary is between 60000 - 80000 £ per year.
As a Senior Machine Learning QA Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning Engineers and software engineers to define and uphold quality standards for ML systems. You are a quality-focused engineer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software.
Responsibilities
- Define ML quality strategy and acceptance criteria across data, model, and system levels
- Design and maintain model evaluation suites, metrics, and test datasets
- Evaluate CAD RL model outputs for geometric validity or policy stability
- Define structured rubrics that translate qualitative findings into measurable evaluation gates
- Test ML models from product side API testing
- Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
- Create and maintain test harnesses for ML services and APIs
- Mentor teams on ML QA best practices and consistent evaluation standards
- Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
- Contribute to multi-team projects and codebases, ensuring code quality and consistency
- Participate in code reviews and provide constructive feedback to peers
- Document and present findings and ideas across the company
Minimum Qualifications
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience
- 7+ years of professional experience in software engineering or QA for ML/AI systems
- Strong programming skills in Python, with experience in test automation
- Familiarity with popular CAD environments tooling
- Proficient in Automation and UAT test suite/framework
- Experience designing QA frameworks or platforms used by multiple teams
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Understanding of software architecture and design patterns
- Ability to work in an agile development environment
Preferred Qualifications
- Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
- Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
- Experience with CI/CD tools and processes
- Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
- Familiarity with MLOps practices (model monitoring, drift, deployment checks)
- Experience with ML evaluation methods, metrics, and benchmarking
- Passion for learning new technologies and improving existing systems
- Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
- Experience testing ML services in production environments
- Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)
The Ideal Candidate
- Demonstrates initiative to provide solutions and to learn and develop new technologies
- Comfortable building QA systems from scratch and writing maintainable automation
- Enjoys learning and collaborating across global locations
- Comfortable working in newly forming ambiguous areas
- Comfortable building scalable and maintainable systems that will be relied on by others
- Communicates well with others
Benefits
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Diversity & Belonging: We take pride in cultivating a culture of belonging where everyone can thrive.
Senior Machine Learning Test Engineer United Kingdom in Sheffield employer: Autodesk
Autodesk is an exceptional employer that fosters a collaborative and innovative work culture, particularly for the Senior Machine Learning Test Engineer role. With a hybrid-first approach, employees enjoy the flexibility of working remotely or in the office, alongside competitive compensation and comprehensive benefits. The company prioritises diversity and belonging, offering ample opportunities for professional growth and development within a global team dedicated to advancing machine learning quality standards.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Machine Learning Test Engineer United Kingdom in Sheffield
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those related to ML testing and automation. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common ML QA scenarios and coding challenges. Practice explaining your thought process clearly, as communication is key in collaborative environments like Autodesk.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team at StudySmarter.
We think you need these skills to ace Senior Machine Learning Test Engineer United Kingdom in Sheffield
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Senior Machine Learning Test Engineer role. Highlight your programming skills in Python, experience with test automation, and any familiarity with CAD environments. We want to see how you fit into our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about quality assurance in ML systems and how your background makes you a great fit for our Research Enablement team. Let us know what excites you about working at StudySmarter!
Showcase Your Projects:If you've worked on relevant projects, whether in a professional or personal capacity, make sure to mention them. We love seeing practical examples of your work, especially if they involve automation, CI/CD, or ML evaluation methods. It gives us a glimpse into your hands-on experience!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows us you’re keen on joining the StudySmarter family!
How to prepare for a job interview at Autodesk
✨Know Your ML Inside Out
Make sure you brush up on your machine learning concepts, especially around model evaluation and quality assurance. Be ready to discuss specific metrics and methodologies you've used in past projects, as this will show your depth of knowledge and experience.
✨Showcase Your Automation Skills
Prepare to talk about your experience with test automation, particularly using Python. Have examples ready where you've implemented CI/CD processes or automated workflows, as this is crucial for the role. Highlight any tools you've used like GitHub Actions or Jenkins.
✨Familiarise Yourself with CAD Tools
Since familiarity with Autodesk CAD software is a requirement, make sure you can discuss your experience with it. If you’ve worked on projects involving CAD environments, be prepared to explain how you ensured quality in those contexts.
✨Collaboration is Key
This role involves working closely with various teams, so be ready to share examples of how you've successfully collaborated in the past. Discuss how you’ve mentored others or contributed to multi-team projects, as strong communication and teamwork skills are essential.
