At a Glance
- Tasks: Evaluate and improve AI coding models through hands-on technical assessments.
- Company: Join Mercor, a partner of a leading AI research lab.
- Benefits: Earn $400 per task with flexible sprint-based work.
- Other info: Limited spots available, so apply quickly to secure your place!
- Why this job: Make an impact in the AI field while honing your engineering skills.
- Qualifications: 2+ years in DevOps or Cloud Engineering and experience with AI tools.
The predicted salary is between 63000 - 77000 £ per year.
About the Role
- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.
- Contributors help evaluate and improve frontier AI coding models through structured technical assessments.
- The work focuses on realistic infrastructure engineering workflows and model evaluation.
- Spots are limited and filling quickly on a first come, first serve basis.
What You'll Do
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
- Identify bugs, edge cases, reliability issues, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
- Time Commitment
- Sprint based project that runs in 12-24 hour stretches based on client requirement.
Compensation
- $400 per accepted task.
- Typical tasks take approximately 2–3 hours after ramp-up.
- Compensation is tied to accepted work.
- Who Should Apply
- 2+ years of professional Dev Ops, SRE, or Cloud Engineering experience.
- Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
- Experience supporting production-scale systems is preferred.
- #J-18808-Ljbffr
DevOps Engineer - AI Model Evaluator employer: Mercor
At Mercor, we pride ourselves on fostering a dynamic and innovative work culture that empowers our employees to excel in their roles. As a Remote Backend Engineer, you'll enjoy the flexibility of working from anywhere while collaborating with cutting-edge AI technology, alongside opportunities for professional growth and development. Our commitment to competitive compensation and a supportive environment makes Mercor an exceptional employer for those seeking meaningful and rewarding work in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land DevOps Engineer - AI Model Evaluator
✨Make Your Portfolio Shine
As a freelancer in software development, your portfolio is your bread and butter. Showcase not only your completed projects but also your coding skills on platforms like GitHub or GitLab. This visibility can lead to clients reaching out to you directly!
✨Join Developer Communities
Get involved in developer communities like Stack Overflow or Reddit's r/programming. Contributing to discussions, sharing your knowledge, or even helping others can expand your network and lead to freelance opportunities. Plus, it keeps you in the loop about what’s trending in software development.
✨Freelance Platforms Are Your Friend
Sign up for popular freelance platforms such as Upwork or Freelancer. They’re filled with people looking for talent like yours! Don’t forget to personalise your pitch to each potential client, highlighting how your unique skills can solve their specific problems.
✨Utilise Your Network
Don’t hesitate to reach out to your existing contacts - you never know who might need your services or can refer you to someone who does. Personal connections can lead to more reliable gigs than cold applications. And we're here to help too! If you're looking for freelance opportunities, check out opportunities listed on our website.
We think you need these skills to ace DevOps Engineer - AI Model Evaluator
Some tips for your application 🫡
Showcase Your GitHub Projects:When applying for a freelance software engineering gig at Mercor, make sure to include your GitHub link in your application. Highlighting your code repositories, contributions to Open Source, and any personal projects can really set you apart and give us insight into your skills and coding style.
Tailor Your CV with Relevant Skills:In software development, the specifics matter! Make sure your CV lists the programming languages and technologies you excel at. Focus on the ones that align with the projects Mercor is working on. Listing your tech stack clearly will help us understand how you fit into our team.
Include a Portfolio of Your Work:A solid portfolio is a must when applying for freelance roles. Include links to any apps, websites, or software you've developed. Highlight any projects that reflect a strong user experience, efficiency, or innovative solutions—this is your chance to shine and show us what you can bring to the table!
Mention Your Availability and Rates:Since this is a freelance role, we want to know when you’re available and what your rates are like! Be upfront about your typical work hours and project timelines. This transparency will help us see if we can sync up for future projects at Mercor.
How to prepare for a job interview at Mercor
✨Showcase Your Code Wizardry
Since you're going for a freelance role in software engineering, have a solid portfolio ready to flaunt your best work. Include projects that highlight your coding skills, frameworks you excel in, and any problem-solving feats you've pulled off. This is your chance to shine, so choose pieces that reflect your unique style and expertise!
✨Prepare for Technical Challenges
Freelance gigs often involve tech assessments or coding challenges, so be ready to tackle some hands-on problems. Brush up on common algorithms, data structures, and any languages/frameworks relevant to the role at Mercor. Being comfortable with platforms like HackerRank or LeetCode can give you an edge and showcase your skills under pressure!
✨Be Clear About Your Rates and Flexibility
As a freelancer, be prepared to discuss your rates upfront. It's crucial to communicate your pricing structure clearly and whether you're open to negotiation. Do your homework on industry standards to ensure you pitch a fair and competitive rate that reflects your skills and experience!
✨Understand Their Tech Stack
Before the interview, get familiar with the tools and technologies used at Mercor. Whether it's a particular framework or a specific coding methodology, being knowledgeable about their tech stack not only shows your interest but also helps you present how you could fit seamlessly into their existing projects. Demonstrating you’ve done your homework can set you apart from other candidates!
