Senior Software AI Engineer, LLM Solutions

Our System Design Automation team is looking for an AI Engineer with solid software skills to join our engineering group.The team develops and sustains a range of tools and capabilities for NVIDIA's current and next-generation hardware platforms — including LLM-powered automation and intelligent debugging solutions, alongside traditional software engineering tools.Our work accelerates issue resolution, improves product reliability, and powers the world's most advanced GPU and data center technologies.NVIDIA's Hardware Networking division is a global leader in end-to-end accelerated computing and connectivity for high-performance data centers — spanning GPUs, networking platforms, and AI software across cloud, HPC, autonomous vehicles, and media & entertainment.

What You'll Be Doing

• Develop and support software tools across the engineering stack — from data processing and backend services to user-facing interfaces
• Build and maintain data pipelines and ETL flows for logs, telemetry, and hardware test data supporting AI/ML workflows
• Prepare, clean, and structure large, complex datasets (structured & unstructured) for LLM training and fine-tuning
• Develop and deploy LLM-based applications for root cause analysis and hardware debugging
• Design and implement agentic workflows — multi-step, tool-using AI agents capable of autonomous reasoning and action
• Experiment with prompt engineering, RAG, and vector search to integrate domain knowledge into models
• Collaborate with hardware, reliability, and AI platform teams to embed intelligent tools into NVIDIA's engineering ecosystem
  
  

What We Need To See

• B.Sc. or M.Sc. in Computer Science, Electrical/Computer Engineering, Data Science, or equivalent practical experience
• 5+ years of experience in software engineering with AI/ML or a related field
• Strong Python skills (pandas, NumPy, PyTorch or TensorFlow)
• Solid understanding of deep learning fundamentals and strong interest in LLMs/NLP
• Hands-on experience with Linux, Git, and container tools (e.g., Docker)
• Strong analytical and problem-solving skills
• Eagerness to learn complex hardware/software systems
  
  

Ways to Stand Out from the crowd

• Experience with full-stack or frontend web development, particularly building internal tools or dashboards using React
• Hands-on experience designing and implementing agentic workflows (e.g., LangChain, LangGraph, AutoGen, or similar frameworks)
• Experience with LLM fine-tuning, prompt engineering, or RAG pipelines
• Familiarity with hardware debugging, observability/logging systems, or chip/system reliability analysis
• Experience with vector databases (FAISS, Pinecone, Milvus) or MLOps tools (MLflow, Kubeflow)
  
  

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most talented and forward-thinking individuals in the world working for us. If you’re creative, data-driven, and eager to build LLM-powered tools that transform hardware engineering, we want to hear from you!NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

, , JR2016712