At a Glance
- Tasks: Create cutting-edge datasets and evaluate AI-generated code for efficiency and reliability.
- Company: Join Turing, a leading research accelerator for frontier AI labs.
- Benefits: Flexible hours, remote work, and potential for contract extensions.
- Other info: Engage in a dynamic environment with opportunities for growth and innovation.
- Why this job: Make an impact in AI by collaborating with top researchers and engineers.
- Qualifications: 3+ years of software engineering experience, strong Python and JavaScript skills.
The predicted salary is between 80000 - 120000 € per year.
About Us: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialise in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents.
Ideal Background: This role is ideal for engineers who have shipped high-impact products at fast-moving companies like Stripe, Airbnb, Cloudflare, Datadog, Coinbase, or similar high-growth engineering environments. We especially welcome graduates from programs with strong CS foundations such as University of Washington, University of Illinois Urbana-Champaign, UT Austin, University of Michigan, Purdue, and comparable institutions — though exceptional experience and skill always take precedence over pedigree.
Project Overview: As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections across the full stack — in Python for backend and ML workflows, and JavaScript (React, Node.js) for frontend and API layers, alongside C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and work with cross-functional teams to enhance enterprise-level AI-driven coding solutions.
What Does a Typical Day Look Like?
- Work on AI model training initiatives by curating code examples, building solutions, and correcting code across both Python and JavaScript (React, Node.js), with additional work in C/C++, Java, Rust, and Go.
- Evaluate and refine AI-generated code across backend and frontend contexts to ensure that it is efficient, scalable, and reliable.
- Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
- Build agents that can verify the quality of the code and identify error patterns across full-stack applications.
- Hypothesise on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them.
- Design verification mechanisms that can automatically verify a solution to a software engineering task.
Required Skills:
- Several years of software engineering experience (3 years or more).
- Strong expertise in building full-stack applications using Python and JavaScript (React, Node.js), with the ability to work across backend and frontend codebases.
- Experience deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.
Engagement Details:
- Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
- Type: Contractor (no medical/paid leave).
- Duration: 1 month (potential extensions based on performance and fit).
- Location: Candidates must be based in the United States.
Evaluation Process: The application process takes 15–30 minutes. Completion of an AI video interview is required. After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile.
Remote working/work at home options are available for this role.
Remote Senior Python Engineer – LLM Evaluation (US-based) in Ramsbottom employer: Turing
Turing is an exceptional employer that fosters a dynamic and innovative work culture, perfect for Senior Python Engineers looking to make a significant impact in the AI field. With flexible remote working options and a commitment to employee growth, Turing provides opportunities to collaborate with top-tier researchers and contribute to cutting-edge projects that shape the future of AI technology. The company's focus on high-quality data and advanced training pipelines ensures that employees are at the forefront of AI advancements, making it a rewarding place to develop your career.
StudySmarter Expert Advice🤫
We think this is how you could land Remote Senior Python Engineer – LLM Evaluation (US-based) in Ramsbottom
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or other platforms. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Prepare for that AI video interview! Brush up on your Python and JavaScript skills, and be ready to showcase your problem-solving abilities. Practice makes perfect, so run through some coding challenges beforehand.
✨Tip Number 3
Show off your projects! Whether it’s on GitHub or your personal website, having a portfolio of your work can really set you apart. Make sure it highlights your best full-stack applications and any AI-related projects.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take that extra step!
We think you need these skills to ace Remote Senior Python Engineer – LLM Evaluation (US-based) in Ramsbottom
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter for the role. Highlight your experience with Python and JavaScript, and any relevant projects you've worked on. We want to see how your skills align with what we're looking for!
Showcase Your Impact:When detailing your past roles, focus on the impact you made. Did you improve efficiency or solve a tricky problem? Use metrics where possible to quantify your achievements. We love seeing how you've contributed to high-impact products!
Be Clear and Concise:Keep your application clear and to the point. Avoid jargon unless it's necessary, and make sure your writing is easy to follow. We appreciate well-structured applications that get straight to the heart of your qualifications.
Apply Through Our Website:Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it makes the whole process smoother for us and you!
How to prepare for a job interview at Turing
✨Know Your Tech Stack
Make sure you’re well-versed in Python and JavaScript, especially React and Node.js. Brush up on your knowledge of C/C++, Java, Rust, and Go too, as these will come in handy during technical discussions.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific examples where you've tackled complex coding challenges. Be ready to explain your thought process and the steps you took to arrive at a solution, as this will demonstrate your analytical skills.
✨Communicate Clearly
Since excellent communication is key for this role, practice articulating your ideas clearly and concisely. Think about how you would explain technical concepts to non-technical stakeholders, as this could come up in the interview.
✨Familiarise Yourself with AI Concepts
Given the focus on AI-driven solutions, it’s beneficial to have a solid understanding of AI principles and how they apply to software engineering. Research recent advancements in AI and be prepared to discuss how they might impact your work.
