At a Glance
- Tasks: Define and measure LLMs' function calling and tool use behaviours.
- Company: Join Mistral AI, a pioneering company transforming the future of AI.
- Benefits: Competitive salary, equity, health insurance, and generous parental leave.
- Other info: Dynamic team culture with opportunities for innovation and growth.
- Why this job: Tackle cutting-edge research challenges and shape best-in-class AI models.
- Qualifications: Expertise in API design, model behaviour, and robust evaluations required.
The predicted salary is between 80000 - 100000 £ per year.
About Mistral
At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratise AI through high-performance, optimised, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise as well as personal needs. Our offerings include Le Chat, La Plateforme, Mistral Code and Mistral Compute - a suite that brings frontier intelligence to end-users. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact.
About the role
As a Model Behavior Architect on the Function Calling team, you are at the forefront of defining and measuring how LLMs use tools, invoke functions, and orchestrate complex agentic workflows. We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and creating eval pipelines for tool use and function calling. Your role is to work hand-in-hand with our Science team to define what 'good' looks like for function calling—from accurate parameter selection and schema adherence to multi-step tool orchestration, error recovery, and agentic reasoning. Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your insights into best-in-class models.
What you will do
- Interact with models to identify where function calling and tool use behaviour can be improved
- Gather internal and external feedback on tool-calling behaviour to scope areas for improvement
- Design and implement evals, data guidelines, data generation, and synthetic tool environments and APIs
- Identify and fix edge case behaviours, such as malformed arguments, hallucinated functions, and incorrect tool selection—through rigorous testing
- Develop robust evaluation pipelines for the function-calling capabilities of our model candidates
- Work collaboratively with AI Scientists
About you
- You have a deep understanding of either 1) API design, structured outputs, and schema specification (e.g. JSON Schema), 2) engineering and code behaviour, 3) LLM agents at work, including reasoning, planning, and multi-step tool use
- You have prior knowledge in training and optimising model behaviour
- You are an expert at building robust evaluations
- You thrive in dynamic and technically complex environments
- You have a track record of delivering innovative, out-of-the-box solutions to address real-world constraints
What we offer
- Competitive salary and equity (stock-options)
- Health insurance
- Transportation allowance
- Sport allowance
- Meal vouchers
- Generous parental leave policy
- Visa sponsorship
By applying, you agree to our Applicant Privacy Policy.
Model Behavior Architect- Function Calling in London employer: Mistral AI
At Mistral AI, we pride ourselves on being an exceptional employer that fosters a dynamic and collaborative work culture, where innovation thrives and every team member's contributions are valued. Our commitment to employee growth is evident through competitive salaries, equity options, and comprehensive benefits including health insurance, transportation allowances, and generous parental leave policies. Join us in our vibrant locations across the globe, where you can engage in cutting-edge AI research and make a meaningful impact in a supportive environment.
StudySmarter Expert Advice🤫
We think this is how you could land Model Behavior Architect- Function Calling in London
✨Tip Number 1
Network like a pro! Reach out to people in the AI field, especially those at Mistral. A friendly chat can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! If you’ve got projects or experiences that highlight your expertise in model evaluation or function calling, don’t be shy—share them during interviews or networking events.
✨Tip Number 3
Prepare for technical challenges! Brush up on your knowledge of API design and structured outputs. Being ready to tackle real-world problems will impress the team at Mistral.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our innovative team.
We think you need these skills to ace Model Behavior Architect- Function Calling in London
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter to highlight your experience with LLMs and function calling. We want to see how your skills align with our needs, so don’t hold back on showcasing your relevant projects!
Showcase Your Passion:Let your enthusiasm for AI and innovation shine through in your application. We’re a dynamic team that thrives on creativity, so share any personal projects or experiences that demonstrate your passion for the field.
Be Clear and Concise:When writing your application, keep it straightforward and to the point. We appreciate clarity, so avoid jargon unless it’s necessary. Make it easy for us to see why you’d be a great fit for the Model Behavior Architect role!
Apply Through Our Website:We encourage you to submit your application directly through our website. It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, you’ll get to explore more about our culture while you’re at it!
How to prepare for a job interview at Mistral AI
✨Know Your Models
Make sure you brush up on your knowledge of large language models and their functionalities. Understand how they interact with APIs and the importance of structured outputs. Being able to discuss specific examples of model behaviour and evaluation will show that you're not just familiar with the theory, but also the practical applications.
✨Showcase Your Problem-Solving Skills
Prepare to discuss past experiences where you've tackled complex issues, especially in function calling or tool use. Think about edge cases you've encountered and how you resolved them. This will demonstrate your ability to think critically and innovate under pressure, which is key for the role.
✨Collaborative Spirit is Key
Since Mistral values teamwork, be ready to share examples of how you've successfully collaborated with others, particularly in technical environments. Highlight any experience working with AI scientists or engineers, as this will resonate well with the team-oriented culture they promote.
✨Ask Insightful Questions
Prepare thoughtful questions about Mistral's projects and future directions in AI. This shows your genuine interest in the company and the role. Inquire about their approach to model evaluation and how they envision the evolution of function calling, which can lead to a deeper discussion during the interview.
