Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join us to build benchmarks for evaluating AI language models using real-world software issues.
- Company: Mercor specializes in recruiting top talent for leading AI labs, backed by industry giants.
- Benefits: Enjoy fully remote work, flexible hours, and competitive pay ranging from $50-100/hr.
- Why this job: Work on impactful projects with cutting-edge technology while collaborating with a talented team.
- Qualifications: Bachelor's degree in Computer Science and 4+ years of software engineering experience or significant open source contributions.
- Other info: This project lasts 4-6 weeks, requiring part-time commitment of 15-20 hours per week.
Description We are seeking excellent software engineers to work with Mercor on a research project with a leading AI startup. In this project, you will help build a benchmark for evaluating their large language model’s abilities to solve real-world software issues sourced from GitHub. Qualifications Bachelors or higher degree in Computer Science (or equivalent) 4+ years of experience in a software engineering role OR significant contributions to an open source project Strong capabilities in Python, Go, C, C++, and/or JavaScript/TypeScript More Role Details The role is fully remote and asynchronous, i.e., you can work according to your own schedule. We ask that you work at least part-time weekly (~15-20 hours per week), but you can work longer if you prefer too. The project is expected to last between 4-6 weeks. This project will be creating a set of evaluations similar to the ones found in the popular SWE-bench and SWE-bench Verified benchmarks. About Mercor Our team is based in San Francisco, CA. We specialize in recruiting experts for top AI labs. Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. Pay Rate: 50-100 USD/hr
Open Source Developer employer: Mercor
Contact Detail:
Mercor Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Open Source Developer
✨Tip Number 1
Familiarize yourself with the latest trends in AI and software engineering. Since this role involves working on a benchmark for evaluating large language models, having a solid understanding of current methodologies and tools in AI will set you apart.
✨Tip Number 2
Engage with the open source community. Contributing to relevant projects on platforms like GitHub can showcase your skills and commitment to open source development, which is crucial for this position.
✨Tip Number 3
Highlight your experience with the programming languages mentioned in the job description. Make sure to have examples ready that demonstrate your proficiency in Python, Go, C, C++, or JavaScript/TypeScript, as these are key to the role.
✨Tip Number 4
Prepare to discuss your previous projects and contributions in detail. Be ready to explain how your work has impacted the projects you've been involved in, especially those related to software engineering and AI.
We think you need these skills to ace Open Source Developer
Some tips for your application 🫡
Highlight Relevant Experience: Make sure to emphasize your experience in software engineering, particularly any significant contributions to open source projects. Detail your proficiency in Python, Go, C, C++, and JavaScript/TypeScript, as these are crucial for the role.
Tailor Your CV: Customize your CV to align with the job description. Focus on showcasing your technical skills and relevant projects that demonstrate your ability to solve real-world software issues.
Craft a Compelling Cover Letter: Write a cover letter that explains why you are interested in this project with Mercor and how your background makes you a perfect fit. Mention your passion for open source development and any specific experiences that relate to the project.
Proofread Your Application: Before submitting, carefully proofread your application materials. Check for any grammatical errors or typos, and ensure that all information is clear and concise. A polished application reflects your attention to detail.
How to prepare for a job interview at Mercor
✨Showcase Your Open Source Contributions
Be prepared to discuss your contributions to open source projects in detail. Highlight specific challenges you faced and how you overcame them, as this demonstrates your problem-solving skills and technical expertise.
✨Demonstrate Language Proficiency
Since the role requires strong capabilities in languages like Python, Go, C, C++, and JavaScript/TypeScript, be ready to showcase your proficiency. You might be asked to solve coding problems or explain concepts related to these languages during the interview.
✨Understand the Project Scope
Familiarize yourself with the project details, especially the benchmarks similar to SWE-bench. Understanding the goals and methodologies of the project will allow you to ask insightful questions and show your genuine interest.
✨Prepare for Remote Work Dynamics
Since the role is fully remote and asynchronous, be ready to discuss how you manage your time and work independently. Share examples of how you've successfully collaborated with teams remotely in the past.
