At a Glance
- Tasks: Define and measure how LLMs use tools and orchestrate workflows.
- Company: Join a cutting-edge tech company leading in AI innovation.
- Benefits: Competitive salary, flexible work options, and opportunities for growth.
- Other info: Collaborative environment with a focus on innovative solutions.
- Why this job: Tackle exciting research challenges and shape the future of AI.
- Qualifications: Expertise in API design, model evaluation, and dynamic problem-solving.
The predicted salary is between 80000 - 100000 £ per year.
About the role
As a Model Behavior Architect on the Function Calling team, you are at the forefront of defining and measuring how LLMs use tools, invoke functions, and orchestrate complex agentic workflows. We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and creating eval pipelines for tool use and function calling. Your role is to work hand‑in‑hand with our Science team to define what "good" looks like for function calling—from accurate parameter selection and schema adherence to multi‑step tool orchestration, error recovery, and agentic reasoning. Join us if you are passionate about tackling cutting‑edge, open‑ended research challenges and transforming your insights into best‑in‑class models.
What you will do
- Interact with models to identify where function calling and tool use behaviour can be improved
- Gather internal and external feedback on tool‑calling behaviour to scope areas for improvement
- Design and implement evals, data guidelines, data generation, and synthetic tool environments and APIs
- Identify and fix edge case behaviours, such as malformed arguments, hallucinated functions, and incorrect tool selection—through rigorous testing
- Develop robust evaluation pipelines for the function‑calling capabilities of our model candidates
- Work collaboratively with AI Scientists
About you
- You have a deep understanding of either 1) API design, structured outputs, and schema specification (e.g. JSON Schema), 2) engineering and code behaviour, 3) LLM agents at work, including reasoning, planning, and multi‑step tool use
- You have prior knowledge in training and optimising model behaviour
- You are an expert at building robust evaluations
- You thrive in dynamic and technically complex environments
- You have a track record of delivering innovative, out‑of‑the‑box solutions to address real‑world constraints
Model Behavior Architect: Function Calling & Tooling employer: Neura Market
As a Model Behavior Architect at our innovative tech company, you will be part of a dynamic team that thrives on pushing the boundaries of machine learning and large language models. We offer a collaborative work culture that fosters creativity and continuous learning, alongside competitive benefits and opportunities for professional growth in a cutting-edge field. Located in a vibrant tech hub, our company provides a unique environment where your contributions directly impact the future of AI technology.
StudySmarter Expert Advice🤫
We think this is how you could land Model Behavior Architect: Function Calling & Tooling
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to model evaluation and function calling. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and problem-solving skills. Practice explaining complex concepts in simple terms, as you'll need to communicate effectively with both technical and non-technical team members.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you're genuinely interested in joining our team at StudySmarter.
We think you need these skills to ace Model Behavior Architect: Function Calling & Tooling
Some tips for your application 🫡
Show Your Passion:When writing your application, let your enthusiasm for model behaviour and function calling shine through. We want to see that you’re genuinely excited about tackling cutting-edge challenges in the field!
Tailor Your Experience:Make sure to highlight your relevant experience in engineering, machine learning, and large language models. We’re looking for specific examples of how you've tackled similar problems or projects in the past.
Be Clear and Concise:Keep your application straightforward and to the point. We appreciate clarity, so avoid jargon unless it’s necessary. Remember, we want to understand your thought process and expertise without getting lost in technical details.
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at Neura Market
✨Know Your Models Inside Out
Make sure you have a solid grasp of large language models and their behaviours. Brush up on how they interact with APIs, function calling, and tool use. Being able to discuss specific examples from your experience will show that you're not just familiar with the theory but can apply it in practice.
✨Showcase Your Evaluation Skills
Prepare to talk about your experience in building evaluation pipelines and how you've tackled edge cases in model behaviour. Bring examples of how you've designed tests or guidelines that improved model performance. This will demonstrate your hands-on expertise and problem-solving abilities.
✨Collaborate Like a Pro
Since this role involves working closely with AI Scientists, be ready to discuss your collaborative experiences. Share instances where you’ve successfully worked in a team to tackle complex challenges. Highlight your communication skills and how you’ve contributed to a shared goal.
✨Stay Curious and Open-Minded
This position is all about tackling cutting-edge research challenges. Show your passion for learning and adapting by discussing recent trends in machine learning and how they might impact function calling. Being open to new ideas will resonate well with the interviewers.
