Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join the team to evaluate AI models and enhance their performance on real-world tasks.
- Company: xAI, a cutting-edge AI company focused on engineering excellence and innovation.
- Benefits: Collaborative culture, hands-on experience, and opportunities for career growth.
- Why this job: Shape the future of AI while working in a dynamic, high-intensity environment.
- Qualifications: Experience in model assessment and evaluation, strong communication skills.
- Other info: Flat organisational structure where initiative and excellence are rewarded.
The predicted salary is between 36000 - 60000 £ per year.
About xAI
xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands‑on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.
About the Role
You will join the Enterprise Model Evaluation team to define and measure how Grok performs on high-value real-world tasks. Your focus will be on identifying critical enterprise use cases and building evaluations that capture performance on those use cases. In doing so, you will uncover model weaknesses, track performance over time, and work with the core modeling team to hill‑climb. Your work will directly shape the future of Grok's capabilities and intelligence. We’re hiring intelligent, execution-focused people for this high-intensity environment—interstellar ambitions demand exceptional talent in a flat, low-overhead culture where smart people get things done without bureaucracy.
Responsibilities
- Provide complete assessment of models
- Deep dive into model training and data to identify the weakness points revealed in evaluation
- Communicate with modeling and data team to produce plans to improve model quality
Basic Qualifications
- Model assessment and evaluation task development (including public and in-house benchmarking)
- Collect data and synthesize data for new evaluations
- Build infrastructure and framework for easy-to-use model evaluation, familiarity with inference frameworks like SGlang and vLLM
Member of Technical Staff - Model Evaluation employer: xAI
Contact Detail:
xAI Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Member of Technical Staff - Model Evaluation
✨Tip Number 1
Network like a pro! Reach out to current employees at xAI on LinkedIn or other platforms. Ask them about their experiences and any tips they might have for landing a role. Personal connections can make a huge difference!
✨Tip Number 2
Prepare for the interview by diving deep into model evaluation concepts. Brush up on your knowledge of benchmarking and performance metrics. Show us that you’re not just a fit for the role, but that you’re genuinely passionate about the work we do!
✨Tip Number 3
Practice your communication skills! Since we value clear and concise sharing of knowledge, try explaining complex concepts to a friend or even to yourself. This will help you articulate your thoughts better during interviews.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows us you’re serious about joining our team and contributing to our mission.
We think you need these skills to ace Member of Technical Staff - Model Evaluation
Some tips for your application 🫡
Show Your Curiosity: When writing your application, let your curiosity shine through! We love candidates who are eager to learn and explore new ideas. Share examples of how you've tackled challenges or sought out knowledge in your previous roles.
Be Concise and Clear: Strong communication skills are key for us at StudySmarter. Make sure your application is clear and to the point. Avoid jargon and focus on conveying your experience and skills in a straightforward manner.
Highlight Your Hands-On Experience: We appreciate candidates who are hands-on and ready to dive into the work. In your application, emphasise any practical experience you have with model evaluation or related tasks. Show us how you've contributed directly to projects in the past!
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re serious about joining our team at xAI!
How to prepare for a job interview at xAI
✨Know Your Models Inside Out
Make sure you have a solid understanding of model evaluation techniques and the specific models you'll be discussing. Brush up on your knowledge of benchmarking and how to assess model performance, as this will be crucial in demonstrating your expertise during the interview.
✨Showcase Your Communication Skills
Since strong communication is key for this role, practice explaining complex concepts in simple terms. Be prepared to discuss how you've effectively communicated with teams in the past, especially when it comes to sharing insights about model weaknesses and improvement plans.
✨Demonstrate Your Initiative
This company values hands-on contributions and initiative. Think of examples from your past experiences where you took charge of a project or identified a problem and proposed a solution. Highlighting these moments will show that you're ready to thrive in their flat organisational structure.
✨Prepare for Technical Questions
Expect technical questions related to model evaluation and data synthesis. Review relevant frameworks like SGlang and vLLM, and be ready to discuss how you would build infrastructure for model evaluation. This will help you stand out as someone who can hit the ground running.