AI/ML Engineer – Microcode Generation Tools

AI/ML Engineer – Microcode Generation Tools

Location: Ramat Hahayal, Tel Aviv

Employer: GSI Israel

Term: Full-time Position

GSI is pioneering the Gemini APU — a next-generation Associative Processing Unit designed to accelerate AI workloads including large language models, deep learning inference, and high-throughput data processing.

We are seeking an inventive and technically strong AI/ML Engineer to develop intelligent tooling that automates and optimizes microcode generation for GSI’s APL (Associative Processing Language).

This role blends machine learning, compiler design, and low-level systems expertise to transform how firmware and microcode are written for our custom APU architecture.

What You’ll Be Owning

• Design and implement AI-assisted tools that generate or optimize APL microcode for the Gemini APU.
• Develop ML-driven and heuristic-based models to map high-level operations into efficient APL syntax.
• Build and fine-tune Retrieval-Augmented Generation (RAG) models that leverage technical documentation, instruction manuals, and code repositories to generate accurate and hardware-aware microcode.
• Collaborate closely with firmware, compiler, and architecture teams to understand instruction constraints, dataflow, and scheduling.
• Prototype code-generation pipelines combining C++ and Python for hybrid AI-assisted toolchains.
• Profile and analyze generated code to ensure optimal utilization of compute units, memory, and bandwidth.
• Build automation, validation, and visualization frameworks to accelerate microcode development.
• Continuously refine generation quality and intelligence using performance feedback and hardware traces.

Qualifications

• B.Sc. or M.Sc. in Computer Science, Electrical Engineering, or Software Engineering.
• 5+ years of hands-on experience in C++ systems development, compiler internals, or firmware/toolchain engineering.
• 2+ years of hands-on AI/ML engineering experience, including model development, fine-tuning, or application for automation and code generation.
• Strong understanding of processor architecture, vectorization, and memory hierarchies.
• Experience with code generation, compiler backends, or low-level optimization.

Preferred Qualifications

• Understanding hardware-aware optimization, scheduling algorithms, and GPU architecture.
• Proficiency in C++ and familiarity with Python-based ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn).
• Experience developing or integrating RAG pipelines for contextual model reasoning or code synthesis.
• Experience integrating AI-assisted code generation into production tool chains.
• Familiarity with retrieval systems, embedding-based search, or domain adaptation for LLMs.

Why Join Us

Join a team shaping the intersection of AI and hardware design. At GSI, you’ll pioneer tools that combine retrieval-augmented intelligence with deep architectural understanding, redefining how microcode is built and optimized for associative computing.

Privacy Statement

All applications will be handled with strict confidentiality. Your information will not be shared without your consent.