Senior Software Engineer – AI Runtime & Performance Optimization

Senior Software Engineer – AI Runtime & Performance Optimization

Location: Tel Aviv (Ramat Hahayal) | Full-Time

Build the Future of AI Computing

At GSI Technology (NASDAQ: GSIT), we're building something different.

Our Gemini® Associative Processing Unit (APU) is a next-generation compute-in-memory processor designed to accelerate large language models, vision models, advanced signal processing, and other demanding AI workloads.

We're looking for an engineer who enjoys understanding how software interacts with hardware and is excited about optimizing AI workloads at the system level.

If you're passionate about performance, architecture, C++, and solving problems that don't yet have standard solutions, we'd love to meet you.

What You'll Do

As part of our AI Software team, you will help bridge the gap between modern AI models and our proprietary hardware architecture.

You will:

• Implement and optimize AI workloads using modern C++
• Convert Python-based AI reference models into highly efficient runtime implementations
• Adapt LLMs, CNNs and Vision Models to a unique compute-in-memory architecture
• Analyze and optimize memory access, latency and throughput bottlenecks
• Design software libraries and runtime infrastructure for AI execution
• Collaborate closely with Data Scientists, Algorithm Engineers and Hardware Architects
• Influence future hardware capabilities through software-driven insights

What We're Looking For

Required

• B.Sc. in Computer Science, Electrical Engineering or equivalent
• 6+ years of experience in software development
• Strong C/C++ programming skills
• Good understanding of computer architecture concepts:
• Memory hierarchy
• Caches
• SIMD / Vector Processing
• Performance optimization
• Experience working close to hardware, embedded systems, DSP, RT systems or low-level software
• Strong debugging and problem-solving skills
• Ability to learn new technologies and architectures quickly

Nice to Have

• Experience with AI/ML frameworks
• Experience optimizing neural network inference
• CUDA, OpenCL or accelerator programming experience
• DSP or signal processing background
• Compiler, SDK or toolchain development experience
• Computer Vision experience
• Familiarity with LLMs, Vision Transformers or CNNs

Why Join Us?

This is a rare opportunity to work at the intersection of:

• AI
• Computer Architecture
• High-Performance Computing
• Embedded Systems

You won't just be optimizing software for existing hardware—you'll help define how a new class of AI processor is programmed and deployed.

If you enjoy deep technical challenges and want to work on technology that pushes the boundaries of AI acceleration, we'd love to hear from you.

GSI Technology is an equal opportunity employer. All applications will be handled with complete confidentiality.