Senior C++ Engineer – Embedded Performance & AI Acceleration

Senior C++ Engineer – Embedded Performance & AI Acceleration

GSI Technology · Tel Aviv District, Israel (Hybrid)

Most AI roles ask you to call PyTorch APIs.

This one asks you to understand what's happening beneath them.

At GSI Technology (NASDAQ: GSIT), we're building the Gemini® APU — a compute-in-memory processor purpose-built to accelerate LLMs, vision models, and advanced signal processing with fundamentally different silicon.

This role fits two kinds of engineers: those coming from real-time / embedded systems who want their next challenge to be AI silicon instead of another firmware stack — and those with an algorithms or performance-optimization background who want to get closer to the metal. If either sounds like you, keep reading.

There's no existing playbook for what we're doing.

🔍 Why this role is different

The gap between modern AI models and novel hardware doesn't close itself.

You'll be the engineer who closes it — by working where C++, computer architecture, and real AI workloads intersect at a level most engineers never reach.

You won't be fine-tuning models. You'll be deciding how they execute on hardware that didn't exist two years ago. No prior AI/ML experience required — what matters is that you think natively in cache lines, memory access patterns, and hardware constraints.

⚙️ What you'll build

• Implement and optimize AI workloads in modern C++ — from Python reference models to high-performance runtime implementations
• Adapt LLMs, CNNs, and Vision Transformers to a unique compute-in-memory execution model
• Identify and eliminate memory access, latency, and throughput bottlenecks
• Design software libraries and runtime infrastructure for AI execution on novel silicon
• Work directly with Hardware Architects — and shape future chip capabilities through software-driven insights

✅ What we need

• Strong C/C++ — you're comfortable thinking in cache lines and memory access patterns
• Experience close to hardware: embedded systems, DSP, real-time systems, or low-level firmware
• Solid grasp of: memory hierarchy, caches, SIMD/vector processing, performance profiling
• Background in algorithm implementation or optimization (signal processing, computer vision, or similar) — from any domain, not necessarily AI
• 6+ years of software development experience
• B.Sc. in Computer Science, Electrical Engineering, or equivalent hands-on experience
• Sharp debugger. Fast learner. High ownership.

⭐ Strong bonus if you bring

• Neural network inference optimization experience
• CUDA, OpenCL, or AI accelerator programming
• Compiler, SDK, or toolchain development
• Familiarity with LLMs, Vision Transformers, or CNNs

📍 Tel Aviv, Ramat Hahayal | Full-Time

💰 Competitive compensation + (NASDAQ: GSIT)

• Curious about the technical problem before you're ready to apply? Reach out — we're happy to start with a conversation.

Our Privacy Policy: Your resume and information will be kept confidential