Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design of next-gen data centre platforms for AI and HPC applications.
- Company: Join NVIDIA, a pioneer in AI and high-performance computing technology.
- Benefits: Enjoy competitive salary, innovative work culture, and opportunities for professional growth.
- Why this job: Be at the forefront of groundbreaking technology and make a real impact on the future.
- Qualifications: PhD or equivalent experience in Computer Science with 15+ years in HPC and parallel programming.
- Other info: NVIDIA is known for its creative and autonomous work environment.
The predicted salary is between 72000 - 108000 £ per year.
Distinguished Software Architect – Deep Learning and HPC Communications
Join to apply for the Distinguished Software Architect – Deep Learning and HPC Communications role at NVIDIA
Distinguished Software Architect – Deep Learning and HPC Communications
4 days ago Be among the first 25 applicants
Join to apply for the Distinguished Software Architect – Deep Learning and HPC Communications role at NVIDIA
Get AI-powered advice on this job and more exclusive features.
NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.
Come work for the team that brought to you NCCL, NVSHMEM & GPUDirect. Our GPU communication libraries are crucial for scaling Deep Learning and HPC applications! We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you ready to contribute to the development of innovative technologies and help realize NVIDIA\’s vision?
What You Will Be Doing
- Research new communication technologies (e.g. expand the GPUDirect technology portfolio) and design new features for our communication libraries
- Propose innovative solutions in HW and SW for our next-gen platforms. You will co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks
- Inspire changes based on quantitative data coming from proof-of-concepts or detailed technical analysis/modeling
- Drive the adoption of new communication technologies across application verticals
- Keep up with the latest DL research and collaborate with diverse teams (internal and external), including DL researchers, and customers
What We Need To See
- PHD in Computer Science, Computer Engineering or related field or strong equivalent experience; 15+ years of relevant experience in academia or the industry
- Expert in following areas: HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA
- Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis
- Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for parallel applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)
- Programming fluency with C or C++ for systems software development
- Flexibility to work and communicate effectively across different HW/SW teams and timezones
Ways To Stand Out From The Crowd
- Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks and keynotes in areas relevant to this role
- Influential role in industry standards (e.g. MPI, OpenSHMEM) and open source software (e.g. PyTorch, UCX, Open MPI)
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you\’re creative and autonomous, we want to hear from you!
JR1997938
Seniority level
-
Seniority level
Mid-Senior level
Employment type
-
Employment type
Full-time
Job function
-
Industries
Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing
Referrals increase your chances of interviewing at NVIDIA by 2x
Get notified about new Software Architect jobs in United Kingdom.
Graduate Software Developer – Fully Remote
Hertford Heath, England, United Kingdom 5 days ago
Front End Developer (18 Month Remote Fixed Term Contract)
Birmingham, England, United Kingdom 2 weeks ago
Graduate Software Developer – Fully Remote
Sheffield, England, United Kingdom 5 days ago
London, England, United Kingdom $140,000.00-$180,000.00 3 weeks ago
London, England, United Kingdom 6 months ago
London, England, United Kingdom $140,000.00-$180,000.00 1 month ago
London, England, United Kingdom 5 days ago
London, England, United Kingdom 3 months ago
London, England, United Kingdom 1 week ago
United Kingdom $75,000.00-$100,000.00 1 month ago
City Of London, England, United Kingdom 3 weeks ago
United Kingdom $75,000.00-$100,000.00 2 weeks ago
London, England, United Kingdom 1 month ago
United Kingdom $100,000.00-$150,000.00 2 months ago
London, England, United Kingdom 1 week ago
Liverpool, England, United Kingdom 3 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Distinguished Software Architect - Deep Learning and HPC Communications employer: Nvidia
Contact Detail:
Nvidia Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Distinguished Software Architect - Deep Learning and HPC Communications
✨Tip Number 1
Network with professionals in the HPC and deep learning fields. Attend relevant conferences, webinars, or meetups to connect with industry leaders and potential colleagues. This can help you gain insights into the latest trends and technologies, making you a more attractive candidate.
✨Tip Number 2
Showcase your expertise by contributing to open-source projects related to HPC or deep learning. This not only demonstrates your skills but also helps you build a portfolio that stands out to employers like us at StudySmarter.
✨Tip Number 3
Stay updated on the latest research and advancements in deep learning and HPC communications. Follow key publications and thought leaders in the field to ensure you can discuss current trends and innovations during interviews.
✨Tip Number 4
Prepare for technical interviews by practising problem-solving and coding challenges specific to HPC and parallel programming. Familiarise yourself with common algorithms and data structures used in these areas to demonstrate your proficiency.
We think you need these skills to ace Distinguished Software Architect - Deep Learning and HPC Communications
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience in HPC, parallel programming models, and GPU architecture. Emphasise any relevant projects or roles that showcase your expertise in deep learning and communication technologies.
Craft a Compelling Cover Letter: In your cover letter, express your passion for AI and HPC. Discuss how your background aligns with NVIDIA's mission and the specific role. Mention any innovative solutions you've proposed in the past and how they relate to the job description.
Showcase Relevant Projects: Include specific examples of projects where you have driven the adoption of new communication technologies or collaborated with diverse teams. Highlight any patents, publications, or conference talks that demonstrate your leadership in the field.
Highlight Continuous Learning: Mention any recent courses, certifications, or research you’ve undertaken related to deep learning and high-performance computing. This shows your commitment to staying updated with the latest advancements in the industry.
How to prepare for a job interview at Nvidia
✨Showcase Your Expertise
Make sure to highlight your extensive experience in HPC and deep learning during the interview. Be prepared to discuss specific projects where you've successfully implemented parallel programming models and communication runtimes, as this will demonstrate your capability for the role.
✨Understand NVIDIA's Technologies
Familiarise yourself with NVIDIA's products and technologies, especially GPUDirect and their communication libraries. Being able to discuss how these technologies impact performance and scalability will show your genuine interest and understanding of the company's work.
✨Prepare for Technical Questions
Expect in-depth technical questions related to network design, performance analysis, and GPU architecture. Brush up on your knowledge of networking technologies like Infiniband and Ethernet, as well as parallel algorithms, to confidently tackle these queries.
✨Demonstrate Collaborative Skills
Since the role involves working across various teams, be ready to share examples of how you've successfully collaborated with diverse groups in the past. Highlight your flexibility in communication and teamwork, especially in cross-functional settings.
