LLM Evaluation Scientist: Data Quality & Metrics
LLM Evaluation Scientist: Data Quality & Metrics

LLM Evaluation Scientist: Data Quality & Metrics

Full-Time 60000 - 84000 £ / year (est.) No home office possible
Perplexity

At a Glance

  • Tasks: Architect automated evaluation pipelines to ensure high-quality answers.
  • Company: Leading tech firm in Greater London with a focus on innovation.
  • Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
  • Why this job: Join a dynamic team and shape the future of AI with your expertise.
  • Qualifications: PhD or MS in a technical field with 4+ years in data science or machine learning.
  • Other info: Exciting projects and a collaborative environment await you!

The predicted salary is between 60000 - 84000 £ per year.

A leading tech firm in Greater London is seeking a specialist to architect automated evaluation pipelines for high-quality answers. The ideal candidate must possess a PhD or MS in a technical field and have at least 4 years of experience in data science or machine learning.

You should be proficient in Python and SQL and comfortable with AWS and Databricks. This role will require you to design evaluation sets to improve overall answer quality and contribute to product changes based on evaluation metrics.

LLM Evaluation Scientist: Data Quality & Metrics employer: Perplexity

As a leading tech firm in Greater London, we pride ourselves on fostering a dynamic and innovative work culture that encourages collaboration and creativity. Our employees benefit from comprehensive professional development opportunities, competitive salaries, and a commitment to work-life balance, making us an excellent employer for those looking to make a meaningful impact in the field of data science and machine learning.
Perplexity

Contact Detail:

Perplexity Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land LLM Evaluation Scientist: Data Quality & Metrics

✨Tip Number 1

Network like a pro! Reach out to folks in the industry on LinkedIn or attend meetups. We all know that sometimes it’s not just what you know, but who you know that can help you land that dream job.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects in data science or machine learning. We want to see your Python and SQL prowess, so don’t hold back on those cool automated evaluation pipelines you've built!

✨Tip Number 3

Prepare for interviews by brushing up on your technical knowledge. We recommend practising common data science problems and being ready to discuss how you’ve used AWS and Databricks in your past work. Confidence is key!

✨Tip Number 4

Apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive about their job search. Let’s get you that LLM Evaluation Scientist role!

We think you need these skills to ace LLM Evaluation Scientist: Data Quality & Metrics

PhD or MS in a technical field
Data Science
Machine Learning
Python
SQL
AWS
Databricks
Automated Evaluation Pipelines
Evaluation Metrics
Answer Quality Improvement
Product Change Contribution

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience in data science and machine learning. We want to see how your skills in Python, SQL, and cloud platforms like AWS and Databricks align with the role.

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Tell us why you're passionate about improving answer quality and how your background makes you the perfect fit for this position.

Showcase Relevant Projects: If you've worked on any projects related to evaluation metrics or automated pipelines, make sure to mention them. We love seeing practical examples of your work that demonstrate your expertise.

Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates from us!

How to prepare for a job interview at Perplexity

✨Know Your Tech Inside Out

Make sure you brush up on your Python and SQL skills before the interview. Be ready to discuss specific projects where you've used these languages, especially in relation to data science or machine learning. This will show that you not only understand the theory but can also apply it practically.

✨Familiarise Yourself with AWS and Databricks

Since this role involves working with AWS and Databricks, take some time to review their functionalities and how they relate to automated evaluation pipelines. You might be asked about your experience with these tools, so having concrete examples ready will help you stand out.

✨Prepare for Evaluation Metrics Discussions

As the job focuses on designing evaluation sets to improve answer quality, be prepared to discuss various evaluation metrics you've used in past projects. Think about how you’ve contributed to product changes based on these metrics and be ready to share those insights.

✨Showcase Your Problem-Solving Skills

During the interview, expect to face some technical challenges or case studies. Practice articulating your thought process clearly and logically. Demonstrating how you approach problem-solving will highlight your analytical skills and fit for the role.

LLM Evaluation Scientist: Data Quality & Metrics
Perplexity

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>