At a Glance
- Tasks: Evaluate AI models, ensure fairness, and analyse data to enhance recruitment processes.
- Company: Join Maki People, a leader in innovative hiring solutions.
- Benefits: Gain hands-on experience, mentorship, and contribute to impactful projects.
- Other info: Be part of a dynamic team driving ethical AI standards in hiring.
- Why this job: Shape the future of recruitment with cutting-edge AI and psychometrics.
- Qualifications: Pursuing or completed MSc/PhD in relevant fields; strong LLM experience required.
The predicted salary is between 20000 - 30000 £ per year.
About The Science Team
At the heart of Maki People, the Science team is shaping the future of hiring through innovation, rigour, and collaboration. Led by our Head of Science, Aiden Loe, and working closely with our COO, Paul-Louis Caylar, this team drives the development of high-quality content that sets our platform apart. We don’t just create and validate assessments—we innovate. Our work spans:
- Expanding a cutting‑edge library of tests and tools.
- Designing bespoke activities and experiences for clients.
- Evaluating and refining AI-driven scoring algorithms and large language models (LLMs) to ensure fairness, accuracy, and transparency.
- Leveraging psychometric expertise to build reliable, valid, and impactful assessments.
- Developing tools that analyze candidate and job data to predict performance and potential with precision.
- Supporting clients in using assessment data to optimize their workforce strategies, from talent acquisition to development and retention.
- Leading original studies to explore emerging psychological and technological trends and sharing insights through publications, presentations, and client reports.
- Collaborating with regulatory bodies and industry leaders to establish new standards in ethical AI use and hiring practices.
- Equipping internal teams and clients with the knowledge and skills needed to understand and apply psychological and AI-driven insights effectively.
As Maki continues to grow, the Science team is central to understanding user experiences, refining assessments, and driving broader adoption—all while upholding the highest scientific standards.
Your impact as an AI Scientist Intern will go beyond day-to-day responsibilities; you’ll be a key partner in shaping the future of recruitment while driving exceptional outcomes for our clients.
About The Role
You’ll work at the intersection of AI and psychometrics, helping ensure Maki’s automated scoring systems are scientifically sound and fair. As an early member of the team, you’ll have real ownership over the work you do. Your main areas of focus will be:
- Model evaluation - testing how accurately and reliably our LLMs score assessments across languages and skills.
- Human-AI comparison - designing studies that compare AI scoring against expert human judgment.
- Bias & fairness - detecting and analysing potential biases across demographic groups and helping build fairer models.
- Predictive analytics - working with assessment data to understand what predicts job performance and retention.
- Model monitoring - investigating anomalies and tracking model performance over time.
- Research - translating findings into insights for non-technical stakeholders and contributing to publications.
What We're Looking For
- Studying towards or recently completed an MSc or PhD in Data Science, Psychometrics, Computational Linguistics, or Psychology.
- Strong hands-on experience with LLMs - prompt engineering, evaluation, benchmarking, and understanding model behaviour.
- Familiarity with NLP techniques used in automated scoring and assessment.
- Some exposure to psychometric methods (IRT, CFA) is a plus.
- Comfortable with Python or R.
- Curious, rigorous, and able to communicate technical findings clearly.
AI Scientist Intern: LLM Scoring & Fairness in London employer: MakiPeople
Maki People is an exceptional employer that fosters a culture of innovation and collaboration within the Science team, where you will have the opportunity to make a meaningful impact on the future of recruitment. With a focus on employee growth, you will gain hands-on experience in cutting-edge AI and psychometrics while working alongside industry leaders, all within a supportive environment that values scientific integrity and ethical practices. Located in a vibrant area, Maki offers unique advantages such as access to a network of professionals and resources that enhance your learning and development.
StudySmarter Expert Advice🤫
We think this is how you could land AI Scientist Intern: LLM Scoring & Fairness in London
✨Tip Number 1
Network like a pro! Reach out to people in the industry, especially those working at Maki People. A friendly chat can open doors and give you insights that might just land you an interview.
✨Tip Number 2
Show off your skills! Create a portfolio or a GitHub repository showcasing your projects related to LLMs and psychometrics. This gives you a chance to demonstrate your hands-on experience and passion for the field.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of AI and psychometrics. Be ready to discuss how you would approach model evaluation and bias detection. We want to see your thought process!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in being part of the Maki team.
We think you need these skills to ace AI Scientist Intern: LLM Scoring & Fairness in London
Some tips for your application 🫡
Show Your Passion for AI and Psychometrics:When writing your application, let your enthusiasm for AI and psychometrics shine through. Share any relevant projects or experiences that highlight your skills and interest in these areas. We love seeing candidates who are genuinely excited about the work we do!
Tailor Your CV and Cover Letter:Make sure to customise your CV and cover letter for the AI Scientist Intern role. Highlight your hands-on experience with LLMs and any relevant coursework or projects. We want to see how your background aligns with our mission at Maki People, so don’t hold back!
Be Clear and Concise:Keep your application clear and to the point. Use straightforward language to explain your experiences and skills. We appreciate candidates who can communicate complex ideas simply, especially since you'll be translating findings for non-technical stakeholders.
Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re serious about joining our team at Maki People!
How to prepare for a job interview at MakiPeople
✨Know Your Models
Make sure you brush up on your knowledge of large language models (LLMs) and their evaluation. Be ready to discuss your hands-on experience with prompt engineering and how you've benchmarked model performance in the past. This will show that you're not just familiar with the theory but have practical insights to share.
✨Understand Fairness and Bias
Since the role focuses on fairness in AI, be prepared to talk about bias detection and analysis. Think of examples where you've identified biases in models or assessments and how you approached building fairer solutions. This will demonstrate your commitment to ethical AI practices.
✨Communicate Clearly
You’ll need to translate complex technical findings into insights for non-technical stakeholders. Practice explaining your research or projects in simple terms. This skill is crucial for collaborating with teams and clients, so showing you can communicate effectively will set you apart.
✨Show Your Curiosity
The Science team values curiosity and innovation. Prepare some thoughtful questions about Maki People’s current projects or future directions in AI and psychometrics. This not only shows your interest in the role but also your eagerness to contribute to their mission of shaping the future of hiring.
