At a Glance
- Tasks: Create coding prompts and evaluate large language model outputs.
- Company: Join Braintrust, a leader in AI and software innovation.
- Benefits: Flexible remote work options and competitive contract rates.
- Other info: Exciting opportunity for career growth in a dynamic tech environment.
- Why this job: Be at the forefront of AI technology and shape the future of LLMs.
- Qualifications: 10+ years in software development with strong Python skills.
The predicted salary is between 70000 - 90000 € per year.
Braintrust is seeking experienced software engineers for an evaluation and annotation team focused on large language models (LLMs). The role requires over 10 years of software development experience, including strong Python skills and familiarity with LLM evaluation.
You will create coding prompts, evaluate model outputs, and document issues. The position is a contract engagement based in the UK, with a preference for London-based candidates, and potential remote work for strong candidates.
Senior LLM Evaluation Engineer & Coding Prompts employer: Braintrust
Braintrust is an exceptional employer that values innovation and expertise, offering a collaborative work culture where experienced software engineers can thrive. With a focus on large language models, employees benefit from meaningful projects that drive technological advancement, alongside opportunities for professional growth and flexible working arrangements, particularly for those based in London. Join us to be part of a forward-thinking team that champions creativity and excellence in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Senior LLM Evaluation Engineer & Coding Prompts
✨Tip Number 1
Network like a pro! Reach out to your connections in the software engineering world, especially those who have experience with LLMs. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your coding prompts and any LLM evaluation projects you've worked on. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your Python skills and understanding LLM evaluation techniques. Practice common coding challenges and be ready to discuss your past experiences in detail.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities waiting for talented engineers like you. It’s the best way to ensure your application gets noticed!
We think you need these skills to ace Senior LLM Evaluation Engineer & Coding Prompts
Some tips for your application 🫡
Show Off Your Experience:Make sure to highlight your 10+ years of software development experience in your application. We want to see your strong Python skills and any relevant projects you've worked on, especially those related to LLM evaluation.
Be Specific About Your Skills:When detailing your skills, be specific about your familiarity with LLM evaluation. We’re looking for concrete examples of how you’ve created coding prompts or evaluated model outputs in the past.
Tailor Your Application:Don’t just send a generic application! Tailor your CV and cover letter to reflect the job description. We love seeing candidates who take the time to connect their experiences with what we’re looking for.
Apply Through Our Website:We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of applications and ensures you’re considered for the role!
How to prepare for a job interview at Braintrust
✨Know Your Python Inside Out
Since the role requires strong Python skills, make sure you brush up on your coding knowledge. Be prepared to discuss your past projects and how you've used Python in LLM evaluation. Practising coding challenges can also help you demonstrate your problem-solving abilities.
✨Familiarise Yourself with LLMs
Understanding large language models is crucial for this position. Research recent advancements in LLM technology and be ready to discuss how you would evaluate model outputs. Showing that you’re up-to-date with industry trends will impress the interviewers.
✨Prepare Coding Prompts
Since you'll be creating coding prompts, think about examples you could share during the interview. Prepare a few prompts that showcase your understanding of LLMs and how they can be evaluated. This will not only highlight your creativity but also your technical expertise.
✨Documenting Issues is Key
The job involves documenting issues, so be ready to talk about your experience with documentation in previous roles. Bring examples of how you've effectively communicated problems and solutions in the past. This shows your attention to detail and commitment to quality.
