Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the evaluation of cutting-edge speech AI models and design innovative testing pipelines.
- Company: Join a well-funded tech company shaping the future of voice interaction.
- Benefits: Enjoy competitive salary, stock options, and fully remote work opportunities.
- Why this job: Make a real impact on next-gen speech systems used globally.
- Qualifications: Experience in speech AI evaluation and strong Python skills required.
- Other info: Be part of a dynamic team with significant growth potential.
The predicted salary is between 36000 - 60000 £ per year.
How do you measure whether an AI voice truly sounds real — and prove it with data? You’ll join an AI team developing large-scale speech and multimodal systems for real-time interaction — models that generate, clone, and understand voice with natural expression and precision. This is a founding evaluation role, in a new dedicated Evals team defining how these models are measured, improved, and deployed safely at scale. You’ll design objective and subjective evaluation pipelines, run large-scale human studies, and build automated systems that turn perception into measurable signal. Your work will span every stage of model development — from research to production — collaborating with speech, audio, and ML teams to close the loop between modelling, feedback, and user experience.
What you’ll do
- Build and scale evaluation pipelines for TTS, voice conversion, and ASR systems
- Design human studies for subjective testing (e.g. MOS, ABX)
- Define and implement objective metrics (WER, intelligibility, naturalness, prosody)
- Automate evaluation dashboards and reporting systems
- Train auxiliary models to capture new evaluation dimensions
- Collaborate across data, model, and product teams to drive measurable improvement
- Establish and scale the evaluation function as the team grows
You’ll bring
- Strong experience building or running eval systems for speech or multimodal models
- Familiarity with ASR, TTS, or voice cloning pipelines
- Experience designing user studies or subjective model evaluation
- Solid understanding of statistics and experimental design
- Proficiency in Python and ML frameworks (PyTorch, Hugging Face, etc.)
- Strong communication skills and cross-functional mindset
Why this role
This is a rare chance to build the evaluation foundation for models already deployed globally — shaping how next-generation speech systems are measured and improved. You’ll have the autonomy to define standards, lead future hires, and see your work directly impact millions of real-world interactions. Fully remote (EU timezones preferred), global team. Competitive salary + meaningful stock options. The company are well funded, with a 9 figure funding round and significant runway for meaningful growth, lots of compute and hiring! Apply today. Everyone will get a response.
Evals Lead, large scale speech ai employer: Trades Workforce Solutions
Contact Detail:
Trades Workforce Solutions Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Evals Lead, large scale speech ai
✨Tip Number 1
Network like a pro! Reach out to people in the industry, especially those working with speech AI. A friendly chat can lead to insider info about job openings or even a referral.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your work with evaluation systems, user studies, or any relevant projects. This gives potential employers a taste of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of ASR, TTS, and voice cloning. Be ready to discuss how you've tackled challenges in these areas and how you can contribute to the team.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we promise everyone will get a response, so you won’t be left hanging.
We think you need these skills to ace Evals Lead, large scale speech ai
Some tips for your application 🫡
Show Your Passion for AI: When you're writing your application, let your enthusiasm for AI and speech technology shine through. We want to see that you’re genuinely excited about the role and how you can contribute to our team!
Tailor Your Experience: Make sure to highlight your relevant experience with evaluation systems, ASR, TTS, or voice cloning. We love seeing how your background aligns with what we’re looking for, so don’t hold back on those details!
Be Clear and Concise: Keep your application straightforward and to the point. We appreciate clarity, so make sure your skills and experiences are easy to understand. This helps us get a quick grasp of what you bring to the table!
Apply Through Our Website: Don’t forget to submit your application through our website! It’s the best way for us to keep track of your application and ensure it gets the attention it deserves. Plus, we promise everyone will get a response!
How to prepare for a job interview at Trades Workforce Solutions
✨Know Your Stuff
Make sure you brush up on your knowledge of speech AI, TTS, and ASR systems. Familiarise yourself with the latest trends and technologies in the field, as well as the specific evaluation metrics mentioned in the job description. This will show that you're not just interested in the role but also passionate about the industry.
✨Prepare for Technical Questions
Expect to dive deep into your experience with evaluation systems and statistical methods. Be ready to discuss your past projects, particularly those involving subjective testing and user studies. Practising how to explain complex concepts clearly will help you communicate effectively during the interview.
✨Show Your Collaborative Spirit
This role involves working closely with various teams, so be prepared to share examples of how you've successfully collaborated in the past. Highlight your communication skills and cross-functional mindset, as these are crucial for driving measurable improvements across different teams.
✨Ask Insightful Questions
At the end of the interview, don’t forget to ask questions that demonstrate your interest in the role and the company. Inquire about the current challenges the Evals team is facing or how they envision the evaluation function evolving. This shows that you're thinking ahead and are genuinely invested in contributing to their success.
