At a Glance
- Tasks: Develop and train cutting-edge Large Language Models for coding tasks.
- Company: Join JetBrains, a leader in developer tools since 2000.
- Benefits: Competitive salary, inclusive culture, and opportunities for professional growth.
- Other info: Work with a dynamic team and access top-tier training infrastructure.
- Why this job: Make a real impact by working on innovative AI projects that shape the future of coding.
- Qualifications: Experience in ML systems, NLP, and deep learning frameworks like PyTorch.
The predicted salary is between 60000 - 80000 £ per year.
At JetBrains, code is our passion. Ever since we started back in 2000, we have been striving to make the world’s most robust and effective developer tools. By automating routine checks and corrections, our tools speed up production, freeing developers to grow, discover, and create. We are working on an ambitious new platform that provides AI capabilities to all JetBrains products. Our platform is based on models developed in-house for writing and coding assistance, as well as integration with our strategic partners.
We are looking for a Research Engineer who can contribute to training foundation models for coding tasks. You’ll be working on developing Large Language Models from scratch and deploying them into production environments where they will be accessible by end users across the globe.
We Value Engineers Who:
- Can plan projects and make decisions independently, consulting with others if needed.
- Identify customer needs and prioritize their tasks accordingly.
- Start with the simplest solutions and gradually add complexity as needed.
- Take sole responsibility for an entire subsystem.
- Have a passion for learning and a desire to stay up to date with the latest developments in the LLM field.
In This Role, You Will:
- Work with stakeholders to convert business requirements into technical specifications.
- Train LLMs from scratch on a large GPU cluster.
- Collect and process pre‑training and fine‑tuning datasets.
- Support and improve existing subsystems.
We’ll be happy to have you on our team if you have:
- Experience in design, deployment, and support of production ML systems.
- A strong theoretical background in NLP and transformer‑based approaches.
- Proficiency with modern deep learning frameworks such as PyTorch and common libraries for NLP.
- Experience in distributed training of multi‑billion parameter models.
- Attention to detail in everything you do and great communication skills.
We’d be especially thrilled if you have experience with:
- LLM inference frameworks such as vLLM, DeepSpeed, TensorRT.
- LLM alignment techniques such as RLHF/RLAIF.
- MLOps tools and practices, including CI/CD for ML.
- K8s and Kubeflow.
- Scientific publications in the NLP field.
How We Develop JetBrains AI:
- A cluster of hundreds of NVIDIA GPUs as training infrastructure.
- Git for source control management.
- Python, PyTorch, and HuggingFace as an ML stack.
- Kubeflow and Weights & Biases for experiment tracking.
- TeamCity as a CI Automation system.
We are an equal opportunity employer. We know great ideas can come from anyone, anywhere. That’s why we do our best to create an open and inclusive workplace – one that welcomes everyone regardless of their background, identity, religion, age, accessibility needs, or orientation.
Staff Research Engineer (LLM Pre-Training) employer: JetBrains
At JetBrains, we pride ourselves on fostering a dynamic and inclusive work environment where innovation thrives. As a Staff Research Engineer, you'll have the opportunity to work with cutting-edge technology in a collaborative culture that encourages continuous learning and professional growth. Our commitment to employee development, combined with our state-of-the-art resources, makes JetBrains an exceptional place for those passionate about advancing AI capabilities in developer tools.
StudySmarter Expert Advice🤫
We think this is how you could land Staff Research Engineer (LLM Pre-Training)
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with JetBrains employees on LinkedIn. A friendly chat can sometimes lead to opportunities that aren’t even advertised!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those related to LLMs or ML systems. This gives you a chance to demonstrate your expertise and passion for the field.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and problem-solving skills. Practice coding challenges and be ready to discuss your past experiences in detail. We want to see how you think!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re genuinely interested in joining the JetBrains team.
We think you need these skills to ace Staff Research Engineer (LLM Pre-Training)
Some tips for your application 🫡
Show Your Passion for Coding:When you're writing your application, let your love for coding shine through! Talk about your experiences and projects that showcase your skills in developing tools or models. We want to see your enthusiasm for the tech world!
Tailor Your Application:Make sure to customise your application to fit the role of Staff Research Engineer. Highlight your experience with LLMs and any relevant projects you've worked on. This helps us see how you can contribute to our ambitious new platform.
Be Clear and Concise:Keep your application straightforward and to the point. Use clear language to describe your skills and experiences. We appreciate attention to detail, so make sure everything is well-organised and easy to read!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy to do!
How to prepare for a job interview at JetBrains
✨Know Your Stuff
Make sure you brush up on your knowledge of NLP and transformer-based approaches. Familiarise yourself with the latest developments in LLMs, as well as the specific tools and frameworks mentioned in the job description, like PyTorch and vLLM. This will show that you're not just a candidate, but someone who's genuinely passionate about the field.
✨Showcase Your Projects
Prepare to discuss any relevant projects you've worked on, especially those involving ML systems or large-scale model training. Be ready to explain your role, the challenges you faced, and how you overcame them. This will demonstrate your hands-on experience and problem-solving skills.
✨Ask Smart Questions
During the interview, don’t hesitate to ask insightful questions about JetBrains' AI development process or their approach to training LLMs. This shows that you're engaged and interested in how they operate, plus it gives you a chance to assess if the company aligns with your own values and goals.
✨Communicate Clearly
Since great communication skills are valued, practice explaining complex technical concepts in simple terms. This will help you connect better with your interviewers and showcase your ability to convey ideas effectively, which is crucial when working with stakeholders.
