Senior Software Engineer, AI Infra

Run:AI has improved AI infrastructure by merging GPU virtualization with Kubernetes-native tech to power innovative AI factories. We aim to speed up enterprise AI projects with smart orchestration, and scalability for AI workloads. Seeking a skilled Senior Software Engineer for our Infrastructure Group to innovate AI technology. The Infrastructure Group is tasked with composing and evolving the core systems responsible for thousands of GPUs and nodes driving enterprise AI. We invent the foundation that facilitates elastic, secure, and observable AI operations at extensive scale. We are seeking engineers who are passionate about distributed systems, modern cloud-native infrastructure, and AI performance optimization.

What You’ll Be Doing

• Crafting and developing enterprise-grade systems with a strong focus on scalability, reliability, and performance.
• Building and optimizing microservices-based architectures using Kubernetes and cloud-native technologies.
• Collaborating closely with backend engineers, product managers, and other partners to deliver impactful solutions.
• Writing clean, maintainable, and testable code in Go, contributing to our CI/CD pipelines.
• Conducting code and build reviews to uphold high-quality standards and mentor team members.
• Leading the development and implementation of advanced identity management systems that secure NVIDIA’s innovative AI and GPU cloud.
• Developing scalable multi-tenant solutions that allow our diverse clientele to harness the power of NVIDIA’s platforms securely and efficiently.
• Collaborating with multi-functional teams to integrate identity and access management features seamlessly into our products, from cloud services to edge computing devices.
  
  

• B.Sc. in Computer Science or a related field (or equivalent experience).
• 5+ years of experience
• Experience in backend software development, including system design and architecture.
• Proficiency in at least one backend programming language (Go preferred).
• Strong knowledge in microservices architecture, RESTful APIs, and relational databases.
• Proficient knowledge of security guidelines and experience applying them in large-scale systems.
• Expertise in implementing OAuth, OIDC, SAML, and other modern authentication protocols - Advantage
  
  

• Expertise in Kubernetes internals and advanced cloud-native technologies.
• Experience working in Linux environments with knowledge of networking, security, and virtualization.
• Contributions to open-source projects or active participation in tech communities.
• Agile approach and familiarity with standard methodologies.