At a Glance
- Tasks: Define and measure LLMs' tool use and function calling for innovative workflows.
- Company: Join a cutting-edge tech company leading in AI and machine learning.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and career advancement.
- Why this job: Tackle exciting research challenges and shape the future of AI technology.
- Qualifications: Expertise in API design, model evaluation, and engineering principles required.
The predicted salary is between 80000 - 100000 £ per year.
About the role
As a Model Behavior Architect on the Function Calling team, you are at the forefront of defining and measuring how LLMs use tools, invoke functions, and orchestrate complex agentic workflows. We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and creating eval pipelines for tool use and function calling. Your role is to work hand-in-hand with our Science team to define what 'good' looks like for function calling—from accurate parameter selection and schema adherence to multi-step tool orchestration, error recovery, and agentic reasoning. Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your insights into best-in-class models.
What you will do
- Interact with models to identify where function calling and tool use behaviour can be improved
- Gather internal and external feedback on tool-calling behaviour to scope areas for improvement
- Design and implement evals, data guidelines, data generation, and synthetic tool environments and APIs
- Identify and fix edge case behaviours, such as malformed arguments, hallucinated functions, and incorrect tool selection—through rigorous testing
- Develop robust evaluation pipelines for the function-calling capabilities of our model candidates
- Work collaboratively with AI Scientists
About you
- You have a deep understanding of either 1) API design, structured outputs, and schema specification (e.g. JSON Schema), 2) engineering and code behavior, 3) LLM agents at work, including reasoning, planning, and multi-step tool use
- You have prior knowledge in training and optimising model behaviour
- You are an expert at building robust evaluations
Model Behavior Architect- Function Calling employer: mistral
As a Model Behavior Architect at our innovative company, you will thrive in a dynamic work culture that champions collaboration and creativity. We offer exceptional employee growth opportunities, including access to cutting-edge research and the chance to work alongside leading experts in AI and machine learning. Located in a vibrant tech hub, our company provides a stimulating environment where your contributions will directly impact the future of function calling and tool use in large language models.
StudySmarter Expert Advice🤫
We think this is how you could land Model Behavior Architect- Function Calling
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio that highlights your projects related to model evaluation and function calling. This is your chance to demonstrate your expertise and make a lasting impression.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and problem-solving skills. Practice explaining complex concepts in simple terms—this will help you communicate effectively with both technical and non-technical interviewers.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team.
We think you need these skills to ace Model Behavior Architect- Function Calling
Some tips for your application 🫡
Show Your Passion:When you're writing your application, let your enthusiasm for model behaviour and function calling shine through. We want to see that you’re genuinely excited about tackling cutting-edge challenges in the field!
Tailor Your Experience:Make sure to highlight your relevant experience in engineering, machine learning, and large language models. We’re looking for specific examples of how you've tackled similar problems or projects in the past.
Be Clear and Concise:Keep your application straightforward and to the point. We appreciate clarity, so avoid jargon unless it’s necessary. Make it easy for us to see how you fit the role without wading through fluff.
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at mistral
✨Know Your Models
Make sure you brush up on your knowledge of large language models and their behaviours. Be ready to discuss specific examples of how you've improved model performance in the past, especially in areas like function calling and tool use.
✨Showcase Your Evaluation Skills
Prepare to talk about your experience with building evaluation pipelines and how you've tackled edge cases in model behaviour. Bring examples of your work that demonstrate your ability to design robust evaluations and handle complex scenarios.
✨Collaborate Like a Pro
Since this role involves working closely with AI Scientists, be ready to discuss your collaborative experiences. Highlight any projects where teamwork led to successful outcomes, especially in engineering or machine learning contexts.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's approach to function calling and model evaluation. This shows your genuine interest in the role and helps you understand how you can contribute to their goals.
