Senior AI Backend Engineer

We Are KPMG Israel.

KPMG Israel is more than a professional services firm, we are a community of people driven by impact. As part of a leading global network, we partner with the most influential organizations to drive large-scale business and technology transformation, combining strategic thinking, innovation, and advanced technologies. Guided by integrity, excellence, and forward thinking, we help organizations navigate complexity and create real change. Our people are at the center, with space to lead, experiment, and grow in a dynamic and collaborative environment that connects personal development with meaningful impact on the future of business and society.

About The Role

We're looking for a Senior AI Backend Engineer who is passionate about building production AI systems and helping shape the technical direction of our AI Engineering team.

You'll combine hands-on software development with technical leadership, driving architecture decisions, mentoring engineers and helping define engineering best practices while remaining deeply involved in designing and building production-grade AI solutions powered by LLMs, RAG architectures and AI Agents.

Working closely with customers, the Development Manager and multidisciplinary teams, you'll help transform complex business challenges into scalable AI systems that deliver measurable business value.

What You'll Do

• Lead the technical design and delivery of end-to-end Generative AI solutions, from architecture through production deployment.
• Design, build and maintain production-grade AI applications and scalable backend services using Python.
• Develop LLM-powered solutions, including RAG architectures, AI Agents and orchestration workflows.
• Drive architecture decisions and technical design across AI solutions.
• Translate business requirements into scalable AI architectures and technical solutions.
• Provide technical leadership through design reviews, code reviews and engineering mentorship.
• Contribute to engineering standards, best practices and technical excellence across projects.
• Evaluate emerging AI frameworks and technologies, incorporating them into production solutions where appropriate.
  
  

• 4+ years of hands-on backend software development experience.
• Strong hands-on Python development skills.
• Experience designing and building scalable backend systems and microservices.
• Hands-on experience building and deploying production Generative AI applications.
• Experience with LLMs, RAG architectures and AI Agent frameworks.
• Experience with AWS, Azure or GCP.
• Experience with Docker and Kubernetes.
• Strong understanding of software architecture and distributed systems.
• Demonstrated technical leadership through architecture ownership, technical decision-making or mentoring other engineers.
• Excellent problem-solving, communication and collaboration skills.