- As a TPU Kernel Engineer, you’ll be responsible for identifying and addressing performance issues across many different ML systems, including research, training, and inference
- A significant portion of this work will involve designing and optimizing kernels for the TPU
- You will also provide feedback to researchers about how model changes impact performance
- Implement low-latency, high-throughput sampling for large language models
- Adapt existing models for low-precision inference
- Build quantitative models of system performance
- Design and implement custom collective communication algorithms
- Debug kernel performance at the assembly level
Benefits
- Comprehensive health, dental, and vision insurance for you and your dependents
- Inclusive fertility benefits via Carrot Fertility
- 22 weeks of paid parental leave
- Flexible paid time off and absence policies
- Mental health support for you and your dependents
- Competitive salary and equity packages
- Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
- Retirement plans with competitive matching
- Life and income protection plans
- $500/month flexible wellness and time saver stipend
- Commuter benefits
- Annual education stipend
- Home office stipends
- Relocation support for those moving for Anthropic
- Daily meals and snacks in the office
- Strong candidates will have a track record of solving large-scale systems problems and low-level optimization
- Want to learn more about machine learning research
- Have significant experience optimizing ML systems for TPUs, GPUs, or other accelerators
- Enjoy pair programming (we love to pair!)
- Understanding accelerators at a deep level, e.g. a background in computer architecture
- Are results-oriented, with a bias towards flexibility and impact
- ML framework internals
- Care about the societal impacts of your work
- Strong candidates may also have experience with:
- Language modeling with transformers
- Pick up slack, even if it goes outside your job description
- High performance, large-scale ML systems
- Designing and implementing kernels for TPUs or other ML accelerators
Education requirements: We require at least a Bachelor’s degree in a related field or equivalent experience
#J-18808-Ljbffr
TPU Kernel Engineer employer: Anthropic
At Anthropic, we pride ourselves on being an exceptional employer that fosters a culture of innovation and collaboration. Our team-oriented environment encourages personal growth and empowers employees to take ownership of their projects, making a meaningful impact in the tech landscape. Located in a vibrant area, we offer competitive benefits and unique opportunities for professional development, ensuring that our engineers thrive both personally and professionally.
