Senior AI Test Architect

We are looking for an AI Test Architect joining E2E Verification group to profile Innovative large scale Distributed training on NVIDIA AI End-to-End solutions in a large scale supercomputing clusters. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated Computing and Deep Learning software and hardware platforms, with researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, Switch, HCA, CPU and GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.What you’ll be doing:Profiling, benchmarking, and analyzing deep learning models to identify areas for optimization and improvement in terms of performance, efficiency, and accuracy, with a strong emphasis on networking aspectsCollaborating closely with data scientists, researchers, development, automation teams to design and implement scalable training pipelines and frameworks that demonstrate large scale high -performance networking capabilitiesStaying up-to-date with the latest advancements in deep learning algorithms, architectures, NVIDIA GPU technologies, and high-performance networking solutionsOptimizing deep learning models for performance, memory usage, and power efficiency while maximizing high-performance networking features on NVIDIA supercomputersProviding insights and recommendations based on the analysis of large-scale training results, specifically focusing on networking bottlenecks and optimizations, to improve model outcomes and achieve business objectivesCollaborating with hardware engineers to guide the development and integration of efficient networking solutions for deep learning, including exploring network architecture optimizations and bringing to bear technologies such as RDMA or InfiniBandWhat we need to see:B.Sc. in Computer Science, Software Engineering, or equivalent experienceStrong understanding and practical experience with machine learning algorithms and techniques, with a specialization in deep learning and expertise in high-performance networking8+ years of overall experience, with CUDA programming for deep learning frameworks like TensorFlow, PyTorch, combined with expertise in networking libraries and protocolsAbility to profile and optimize deep learning workflows, focusing on networking-related bottlenecks and optimizations, to improve overall performance and efficiencyExceptional analytical and problem-solving skill, with a keen attention to detail, particularly in identifying and resolving networking performance issuesExcellent communication and collaboration skills, enabling effective teamwork and cooperationFamiliarity with supercomputers, parallel computing, distributed systems, and high- performance networking technologies like RDMA or InfiniBandWays to stand out from the crowd:Demonstrated experience in successfully profiling and optimizing large-scale deep learning training on NVIDIA supercomputers, with a significant focus on high-performance networking enhancementsExperience with distributed deep learning, distributed training frameworks, or large-scale data pipelines enhanced by high-performance networking solutionsExpertise in optimizing networking parameters, such as bandwidth, latency, or congestion control, for deep learning workloadsFamiliarity with NVIDIA's networking technologies, such as Mellanox InfiniBand, and their integration with deep learning workflowsStrong understanding of high-performance networking protocols and standards and their application to deep learningNVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.