Senior Architect, LLM Networking Data Scientist

NVIDIA is a global technology leader in AI, GPU computing, and accelerated computing. NVIDIA is looking for a dynamic and innovative LLM Networking data scientist to join our premier research and development group. In this role, you will play a pivotal role in advancing networking technologies to support the deployment and optimization of large language models (LLMs), which are instrumental in revolutionizing AI, natural language processing (NLP), and machine learning. As a part of Networking Cyber AI group, LLM Networking data scientist at NVIDIA, you will be at the forefront of crafting technologies that empower the future of AI.

What You'll Be Doing

• Be part of advanced research efforts to investigate and develop architectural solutions for optimizing the networking aspects of large language models. This may involve designing new algorithms, protocols, and techniques that enhance LLM performance across distributed systems.
• Collaborating with multi-functional teams to design and architect networking infrastructures that are tailored to support the training, deployment, and efficient inference of large language models.
• Identifying bottlenecks and areas for improvement within the networking stack of LLMs. Developing and implementing innovative strategies to optimize data transfer, minimize latency, and improve bandwidth utilization to enhance overall performance.
• Conducting thorough performance analysis, benchmarking, and testing of networking solutions in real-world scenarios. Ensuring that the designed architectures meet the specific and demanding requirements of large language models
  
  

• A Ph.D. or Master’s degree in computer science, or a related field, with a strong emphasis on networking, distributed systems, or a relevant area of expertise, 7 years.
• At least 5 years’ experience as NLP data scientist / data engineer in a known software / product company.
• Hands-on development experience in NLP, LLM and GPU/CUDA technology stack.
• Deep understanding of LLM frameworks, such, and their networking requirements.
• Strong problem-solving skills, creativity, and a genuine passion for pushing the boundaries of networking performance in AI.
• Excellent communication and collaboration skills, with the ability to work effectively in a multidisciplinary team.
• A strong publication record in reputable conferences and journals is highly desirable.
  
  

• Exude high energy and a positive attitude.
• Stellar verbal and written communication skills
• Passionate about data science and implementation
• Want to make what was impossible possible!