AI Software Engineering Manager

Description:

About Us

We are an NVIDIA partner, delivering professional services in advanced software development, artificial intelligence systems, and high-performance AI solutions. We build production-grade AI systems optimized for NVIDIA GPU platforms, working across multiple applied AI domains, including Generative AI / Agentic Systems.

Role Overview

We are looking for an experienced AI Software Engineering Manager to take a leading role in designing, building, and delivering advanced AI systems for real-world applications.

This role is suited for a hands-on engineering manager with strong software engineering, project management and leadership skills and deep experience in applied AI, who enjoys solving complex problems, owning technical solutions end-to-end, mentoring team members, and engaging with customers.

Projects typically focus on LLM or Multimodal LLM based agentic systems.

What We Work On

Our work spans software engineering and AI domains:

• Design and implementation of agentic systems powered by Large Language Models (LLMs)
• Deployment of open-source LLMs on NVIDIA GPUs
• High-performance inference using NVIDIA technologies such as NVIDIA NIM (Inference Microservices)
• System-level design for reliability, scalability, and performance
• Multimodal agents for text, image, audio, and video processing
• Performance optimization on GPU platforms.

Key Responsibilities

• Lead, manage, and develop a high-performing team of AI Software Engineers, fostering a strong engineering culture, setting clear expectations, providing ongoing coaching and feedback, managing performance, and supporting individual career growth.
• Lead and manage AI software engineering projects end-to-end, from planning to deployment, while actively designing and hands-on coding core components of the solution.
• Lead or facilitate Agile execution, including sprint planning, backlog refinement, daily stand-ups, and retrospectives.
• Drive technical excellence through code reviews, design reviews, and architecture discussions, guiding the team in building scalable, reliable, maintainable, and secure software systems with clean code and rigorous software engineering practices.
• Serve as the primary technical point of contact for customers and/or product teams, translating requirements into effective technical solutions.

• BSc or MSc in Computer Science, Electrical Engineering, or a related field
• 7+ years of hands-on Software Engineering
• experience in designing and developing complex systems across all software layers, including AI pipelines, middleware, databases, backend, and frontend
• 2 years of experience in leading people and project management, preferably with Agile methodologies
• 2+ years of experience in building AI and LLM-based software systems in the cloud, including agentic workflows, reasoning systems, prompt engineering, and/or harness engineering
• Strong proficiency in Python and modern AI frameworks
• Deep knowledge of Software Engineering principles, including software architecture, design patterns, clean code, test-driven development, code quality, maintainability, and observability Experience with system-level design, debugging, and performance optimization

Nice to Have

• Experience with NVIDIA technologies (CUDA, TensorRT, Triton, NVIDIA NIM)
• Experience with GPU performance profiling and optimization
• Experience with Multimodal LLM agents for text, image, audio, and video processing
• Experience with LangChain, LangGraph, React, TypeScript, Redis Pub/Sub, SQL, NoSQL, vector databases, containerized development, Git
• Experience with deep learning architectures (CNNs, Transformers)
• Background in high-performance or low-latency systems Experience leading and collaborating with distributed engineering teams across multiple countries

What We Offer

• Ownership of complex, high-impact AI projects
• Work with cutting-edge NVIDIA GPU and AI technologies
• Influence over architecture, tooling, and technical direction
• A collaborative, engineering-driven culture
• Real-world, production-scale AI challenges

Full time Job

Location: Haifa, Hybrid

We at Deloitte believe that diversity and inclusion among our people is a critical component of our success and that is why we cultivate an organizational culture that contains and embraces diversity in all its forms.