Senior Deep Learning Performance Engineer - Training at Scale

Overview

Senior Deep Learning Performance Engineer – Training at Scale at NVIDIA. We are looking for senior engineers who are mindful of performance analysis and optimization to help squeeze every last clock cycle out of Deep Learning training, inference and NVIDIA AI Services. We work across all layers of the hardware/software stack, from GPU architecture to Deep Learning Framework, to achieve peak performance. This role offers an opportunity to directly impact the hardware and software roadmap in a fast-growing company that leads the AI revolution. Join the team building software used by the entire world. Work with world class software engineers to implement blazingly fast SOTA deep learning models that help understanding the end-to-end performance of NVIDIA’s DL software and hardware stack. Work on the most powerful, enterprise-grade GPU clusters capable of hundreds of Peta FLOPS and on unreleased hardware before anyone in the world.

What You’ll Be Doing

• Implement deep learning models from multiple data domains (CV, NLP/LLMs, ASR, TTS, RecSys and others) in multiple DL frameworks (PyT, JAX, TF2, DGL and others)
• Implement and test new software features (Graph Compilation, reduced precision training) that use the most recent hardware functionalities
• Analyze, profile, and optimize deep learning workloads on state-of-the-art hardware and software platforms
• Collaborate with researchers and engineers across NVIDIA, providing guidance on improving the design, usability and performance of workloads
• Lead best-practices for building, testing, and releasing DL software

What We Need To See

• 5+ years of experience in DL model implementation and software development
• BSc, MS or PhD degree in Computer Science, Computer Architecture, Mathematics, Physics or related technical field or equivalent experience
• Excellent Python programming skills, extensive knowledge of at least one DL Framework
• Strong problem solving and analytical skills
• Algorithms and DL fundamentals

Ways To Stand Out From The Crowd

• Experience in performance measurements and profiling
• Experience with running large-scale workloads in HPC clusters
• Knowledge and love for DevOps/MLOps practices for Deep Learning-based product’s development
• Solid understanding of Linux environments and containerization technologies such as Docker
• GPU programming experience (CUDA or OpenCL) is a plus but not required

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.