At a Glance
- Tasks: Join us to build benchmarks for evaluating AI language models using real-world software issues.
- Company: Mercor specializes in recruiting top talent for leading AI labs, backed by industry giants.
- Benefits: Enjoy fully remote work, flexible hours, and competitive pay ranging from $50-100/hr.
- Why this job: Work on impactful projects with cutting-edge technology while collaborating with a talented team.
- Qualifications: Bachelor's degree in Computer Science and 4+ years of software engineering experience or significant open source contributions.
- Other info: This project lasts 4-6 weeks, requiring part-time commitment of 15-20 hours weekly.
Description We are seeking excellent software engineers to work with Mercor on a research project with a leading AI startup. In this project, you will help build a benchmark for evaluating their large language model’s abilities to solve real-world software issues sourced from GitHub. Qualifications Bachelors or higher degree in Computer Science (or equivalent) 4+ years of experience in a software engineering role OR significant contributions to an open source project Strong capabilities in Python, Go, C, C++, and/or JavaScript/TypeScript More Role Details The role is fully remote and asynchronous, i.e., you can work according to your own schedule. We ask that you work at least part-time weekly (~15-20 hours per week), but you can work longer if you prefer too. The project is expected to last between 4-6 weeks. This project will be creating a set of evaluations similar to the ones found in the popular SWE-bench and SWE-bench Verified benchmarks. About Mercor Our team is based in San Francisco, CA. We specialize in recruiting experts for top AI labs. Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. Pay Rate: 50-100 USD/hr
Open Source Developer employer: Mercor
Contact Detail:
Mercor Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Open Source Developer
✨Tip Number 1
Familiarize yourself with the latest trends in AI and software engineering. Since this role involves working on a benchmark for evaluating large language models, having a solid understanding of current AI technologies and methodologies will set you apart.
✨Tip Number 2
Engage with the open source community. Contributing to relevant projects on platforms like GitHub can showcase your skills and experience. It’s also a great way to network with other developers who might have insights or connections related to this position.
✨Tip Number 3
Highlight your experience with the programming languages mentioned in the job description. Make sure to be ready to discuss specific projects where you've used Python, Go, C, C++, or JavaScript/TypeScript, as this will demonstrate your technical capabilities.
✨Tip Number 4
Prepare to discuss your approach to problem-solving in software development. Given that the project involves real-world software issues, being able to articulate your thought process and how you tackle challenges will be crucial during discussions.
We think you need these skills to ace Open Source Developer
Some tips for your application 🫡
Highlight Relevant Experience: Make sure to emphasize your experience in software engineering, particularly any significant contributions to open source projects. Detail your proficiency in Python, Go, C, C++, and JavaScript/TypeScript, as these are crucial for the role.
Tailor Your CV: Customize your CV to reflect the qualifications mentioned in the job description. Include specific projects or roles that demonstrate your skills and experience relevant to the research project with Mercor.
Craft a Compelling Cover Letter: Write a cover letter that not only outlines your technical skills but also expresses your enthusiasm for working on AI-related projects. Mention why you are interested in this particular opportunity with Mercor and how you can contribute to their goals.
Submit Your Application: Once you have prepared your documents, submit your application through our website. Ensure all information is accurate and that you have included all required materials before hitting send.
How to prepare for a job interview at Mercor
✨Showcase Your Open Source Contributions
Be prepared to discuss your contributions to open source projects in detail. Highlight specific challenges you faced and how you overcame them, as this demonstrates your problem-solving skills and technical expertise.
✨Demonstrate Language Proficiency
Since the role requires strong capabilities in languages like Python, Go, C, C++, and JavaScript/TypeScript, be ready to showcase your proficiency. You might be asked to solve coding problems or explain concepts related to these languages during the interview.
✨Understand the Project Scope
Familiarize yourself with the project details mentioned in the job description, especially the benchmarks like SWE-bench. This will allow you to ask informed questions and show your genuine interest in the work you'll be doing.
✨Emphasize Remote Work Experience
Since the position is fully remote and asynchronous, share your experiences working in similar environments. Discuss how you manage your time effectively and maintain communication with team members across different time zones.