Software Engineer -AI Backend

About the Team

At KPMG Israel, our Generative AI delivery team builds end-to-end AI-powered products for clients across diverse industries. Our projects range from intelligent API services to complete production systems including user management, complex databases, process orchestration, and cloud infrastructure. We combine strong software engineering with AI capabilities to deliver solutions that create real business value.

About the Role

We're looking for a Software Engineer with strong backend and cloud expertise to join our AI team. You'll design and build backend systems that integrate Generative AI capabilities, contributing across the stack from API development to cloud deployment.

This role is ideal for someone who thinks in systems, loves solving complex problems, and can go deep into implementation details while keeping the big picture in mind. You'll work closely with our team lead on architectural decisions and take ownership of project delivery.

Key Responsibilities

Systems Design & Development

Design and build complete backend systems APIs, databases, queues, authentication, and integrations
Develop Python services with strong focus on code quality, performance, and reliability

· Design solutions that scale across different client environments (cloud and on-prem)

AI Integration

Integrate LLMs (Multi Agents Systems) and GenAI capabilities into production systems
Build orchestration layers and workflows that combine AI with traditional backend logic
Optimize AI system performance, cost, and reliability

Cloud & Infrastructure

Deploy and manage systems across major cloud platforms (GCP, Azure, AWS)
Work with cloud-native services, databases, and infrastructure tools
work with production systems, monitoring, and operational health

Collaboration & Delivery

Communicate with client development teams, DevOps, and business stakeholders
Guide frontend developers on API contracts and integration requirements
Contribute to technical decisions and solution design within the team

Client Engagement & Advisory

Lead technical discussions with clients and translate business needs into technical architectures
Present GenAI solutions, design decisions, and trade-offs to technical and non-technical stakeholders

Provide strategic technical guidance

Requirements:

Must Have

3+ years of relevant software engineering experience
Working knowledge of GenAI concepts and LLM integration
Strong proficiency in Python for backend development
Solid experience designing and building production systems (APIs, Microservices, databases, message queues, authentication)
Hands-on experience with at least one major cloud platform (GCP, Azure, or AWS)
Understanding of software architecture patterns and best practices

· Bachelor’s degree in Computer Science or related field or equivalent practical experience

Advantages

Experience with multiple cloud platforms
Docker and Kubernetes experience
Experience with LLM provider APIs (OpenAI, Anthropic, Google) including function calling and streaming
Data pipeline development experience

What We're Looking For

Strong problem-solving skills ability to model a problem correctly and propose complete solutions
Attention to detail and ability to go deep into implementation

· Ability to quickly learn and apply new technologies, especially in the GenAI space

· Clear technical communication skills

Comfort working in a fast-paced consulting environment with varying project types

What We Offer

Variety of projects from focused AI services to complete production systems.
Exposure to multiple industries, cloud platforms, and technical challenges.
Opportunity to grow technical leadership skills.
Collaborative team environment with hands-on architectural guidance.
Continuous learning in a rapidly evolving field.