Senior Architect, Large Scale Distributed Training

As NVIDIANs, we see problems that other people have never encountered. However, we also have capabilities and access to technology that few people have. Our group leads, invents, evangelizes, creates architecture, and educates on using novel technologies. Do you want to lead the industry, too? We are seeking an Architect or a talented SW Engineer who wishes to move into an architect position. A person with a good system understanding and fully hands-on skills who want to be part of the technology seeding phase. In this position, you will invent, run proof of concepts, and write specifications for the engineering groups. Come and help us lead the next-generation data center technology!

What you'll be doing:

Learn our architecture with a focus on the technology that we drive

Optimize AI/ML model training time at large scale

Code and build proof-of-concept prototypes.

Design and define protocols and APIs for leveraging our technology in a data center

Research and evaluate algorithms currently used in related applications

Participate in defining hardware and system features, and assist software and hardware groups in enabling new technologies.

What we need to see:

B.Sc./M.Sc. or equivalent experience in Electrical Engineering or Computer Science from a leading university

3-5 years of proven experience in the industry, specifically in SW engineering, distributed AI system training

Familiarity with networking concepts, terms, and software stack

Passion for problem-solving and algorithms research and development

Background in distributed AI/ML models training on GPU’s clusters

Ways to stand out from the crowd:

Background in data center architecture

Experience with Collective Communications Library such as NCCL

good understanding of OS, driver and performance aspects of a system

Background in network synchronization protocols such as IEEE 1588 PTP

Good command of Python, C/C++

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.