At a Glance
- Tasks: Lead the evaluation of AI speech models and design innovative testing pipelines.
- Company: Join a well-funded AI team shaping the future of voice technology.
- Benefits: Competitive salary, stock options, and fully remote work.
- Other info: Be part of a dynamic team with significant growth opportunities.
- Why this job: Make a real impact on next-gen speech systems used globally.
- Qualifications: Experience in speech evaluation, Python proficiency, and strong communication skills.
The predicted salary is between 60000 - 80000 € per year.
How do you measure whether an AI voice truly sounds real — and prove it with data? You’ll join an AI team developing large-scale speech and multimodal systems for real-time interaction — models that generate, clone, and understand voice with natural expression and precision. This is a founding evaluation role, in a new dedicated evals team defining how these models are measured, improved, and deployed safely at scale. You’ll design objective and subjective evaluation pipelines, run large-scale human studies, and build automated systems that turn perception into measurable signal. Your work will span every stage of model development — from research to production — collaborating with speech, audio, and ML teams to close the loop between modelling, feedback, and user experience.
What you’ll do:
- Build and scale evaluation pipelines for TTS, voice conversion, and ASR systems
- Design human studies for subjective testing (e.g. MOS, ABX)
- Define and implement objective metrics (WER, intelligibility, naturalness, prosody)
- Automate evaluation dashboards and reporting systems
- Train auxiliary models to capture new evaluation dimensions
- Collaborate across data, model, and product teams to drive measurable improvement
- Establish and scale the evaluation function as the team grows
You’ll bring:
- Strong experience building or running eval systems for speech or multimodal models
- Familiarity with ASR, TTS, or voice cloning pipelines
- Experience designing user studies or subjective model evaluation
- Solid understanding of statistics and experimental design
- Proficiency in Python and ML frameworks (PyTorch, Hugging Face, etc.)
- Strong communication skills and cross-functional mindset
Why this role:
This is a rare chance to build the evaluation foundation for models already deployed globally — shaping how next-generation speech systems are measured and improved. You’ll have the autonomy to define standards, lead future hires, and see your work directly impact millions of real-world interactions. Fully remote (EU timezones preferred), global team. Competitive salary + meaningful stock options. The company are well funded, with a 9 figure funding round and significant runway for meaningful growth, lots of compute and hiring! Apply today. Everyone will get a response.
Speech Evaluation Lead employer: techire ai
As a Speech Evaluation Lead, you'll be part of an innovative AI team dedicated to developing cutting-edge speech and multimodal systems. Our fully remote work culture fosters collaboration across global teams, offering competitive salaries, meaningful stock options, and ample opportunities for professional growth. Join us in shaping the future of voice technology while enjoying the flexibility and support that comes with being part of a well-funded company poised for significant expansion.
StudySmarter Expert Advice🤫
We think this is how you could land Speech Evaluation Lead
✨Tip Number 1
Network like a pro! Reach out to people in the industry, especially those working with speech and multimodal models. A friendly chat can lead to insider info about job openings or even a referral.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your experience with evaluation systems, user studies, and any projects related to ASR or TTS. This will give you an edge when discussing your fit for the role.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of metrics like WER and naturalness. Be ready to discuss how you've applied these in past projects, as this will demonstrate your expertise and passion for the field.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we promise everyone will get a response, so you won’t be left hanging.
We think you need these skills to ace Speech Evaluation Lead
Some tips for your application 🫡
Show Your Passion for AI:When writing your application, let your enthusiasm for AI and speech technology shine through. We want to see how excited you are about the potential of voice models and how you can contribute to our mission at StudySmarter.
Highlight Relevant Experience:Make sure to showcase your experience with evaluation systems, ASR, TTS, or voice cloning in your application. We’re looking for specific examples that demonstrate your skills and how they align with the role of Speech Evaluation Lead.
Be Clear and Concise:Keep your application straightforward and to the point. We appreciate clarity, so avoid jargon and focus on communicating your ideas effectively. This will help us understand your qualifications better.
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to receive your details and ensures you’re considered for this exciting opportunity. We can’t wait to hear from you!
How to prepare for a job interview at techire ai
✨Know Your Stuff
Make sure you brush up on your knowledge of speech evaluation systems, especially TTS, ASR, and voice cloning. Familiarise yourself with the metrics mentioned in the job description, like WER and intelligibility, so you can confidently discuss how you've applied them in past projects.
✨Showcase Your Experience
Prepare specific examples from your previous roles where you've built or run evaluation systems. Be ready to explain the challenges you faced and how you overcame them, particularly in designing user studies or subjective evaluations.
✨Collaboration is Key
This role involves working closely with various teams, so highlight your cross-functional experience. Think of instances where you've collaborated with data, model, or product teams to drive improvements and be prepared to discuss how you communicate effectively across disciplines.
✨Ask Insightful Questions
At the end of the interview, don’t shy away from asking questions that show your interest in the role and the company. Inquire about their current evaluation processes or how they envision the growth of the evaluation function. This not only shows your enthusiasm but also helps you gauge if the company is the right fit for you.
