At a Glance
- Tasks: Architect automated evaluation pipelines for high-quality answers and design evaluation sets.
- Company: Leading tech firm in Greater London with a focus on innovation.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Exciting environment with cutting-edge technology and career advancement opportunities.
- Why this job: Join a dynamic team and make a real impact on product quality and user experience.
- Qualifications: PhD or MS in a technical field with 4+ years in data science or machine learning.
The predicted salary is between 60000 - 80000 £ per year.
A leading tech firm in Greater London is seeking a specialist to architect automated evaluation pipelines for high-quality answers. The ideal candidate must possess a PhD or MS in a technical field and have at least 4 years of experience in data science or machine learning.
You should be proficient in Python and SQL and comfortable with AWS and Databricks. This role will require you to design evaluation sets to improve overall answer quality and contribute to product changes based on evaluation metrics.
LLM Evaluation Scientist: Data Quality & Metrics in London employer: Perplexity
At Perplexity, we pride ourselves on fostering a dynamic and innovative work culture that empowers our employees to make a real impact in the tech industry. As a member of our small, dedicated team in a vibrant location, you'll enjoy opportunities for professional growth while working on cutting-edge infrastructure projects that redefine how users interact with the internet. We offer competitive benefits, a collaborative environment, and the chance to contribute to meaningful advancements in search technology.
StudySmarter Expert Advice🤫
We think this is how you could land LLM Evaluation Scientist: Data Quality & Metrics in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. We all know that sometimes it’s not just what you know, but who you know that can help you land that dream job.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects in data science or machine learning. We want to see your Python and SQL prowess, so make sure to highlight any automated evaluation pipelines you've worked on.
✨Tip Number 3
Prepare for those interviews! Brush up on your technical knowledge and be ready to discuss how you’ve used AWS and Databricks in your past work. We recommend practising common interview questions related to data quality and metrics.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace LLM Evaluation Scientist: Data Quality & Metrics in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience in data science and machine learning. We want to see how your skills in Python, SQL, and cloud platforms like AWS and Databricks align with the role.
Craft a Compelling Cover Letter:Use your cover letter to tell us why you're passionate about improving answer quality. Share specific examples of how you've designed evaluation sets or contributed to product changes in the past.
Showcase Your Technical Skills:Don’t just list your technical skills; demonstrate them! If you’ve worked on automated evaluation pipelines or similar projects, give us the details. We love seeing real-world applications of your expertise.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates from our team.
How to prepare for a job interview at Perplexity
✨Know Your Tech Inside Out
Make sure you brush up on your Python and SQL skills before the interview. Be ready to discuss specific projects where you've used these languages, especially in relation to data science or machine learning. This will show that you not only understand the theory but can also apply it practically.
✨Familiarise Yourself with AWS and Databricks
Since this role involves working with AWS and Databricks, take some time to review their functionalities and how they relate to automated evaluation pipelines. You might be asked about your experience with these tools, so having concrete examples ready will help you stand out.
✨Prepare for Evaluation Metrics Discussions
As the job focuses on designing evaluation sets to improve answer quality, be prepared to discuss various evaluation metrics you've used in past projects. Think about how you’ve contributed to product changes based on these metrics and be ready to share those insights.
✨Showcase Your Problem-Solving Skills
In interviews for technical roles, problem-solving is key. Prepare to tackle hypothetical scenarios related to data quality and metrics. Practising how you would approach these challenges will demonstrate your analytical thinking and ability to innovate in the field.
