LLM Systems / AI Pipeline Engineer

About the opportunity

A cutting-edge AI startup transforming how software is imagined, built, and launched is looking for an LLM Systems / AI Pipeline Engineer to build and improve the intelligence layer behind its platform.

You will work with models from OpenAI, Anthropic, and Google, taking ownership of intent routing, context management, and the reliability and efficiency of production AI workflows.

What you will do

• Build routing mechanisms that identify user intent and select the appropriate workflow.

• Optimize context windows through prompt compression and selective file injection.

• Implement safeguards against unintended code overwrites.

• Measure and improve latency, token consumption, and API costs.

• Develop reliable processing of Hebrew and English commands and requests.

• Investigate pipeline failures and improve system behavior.

Requirements

• At least 3 years of software engineering experience, including at least 2 years building production LLM systems or AI pipelines.

• Practical expertise in context window management, prompt compression, and selective file injection.

• Experience building intent classification and routing systems that combine deterministic rules, heuristics, embeddings, and lightweight models.

• Experience processing Hebrew and English inputs, including phrase and command normalization.

• Ability to measure and optimize performance, token usage, and operating costs.

An advantage

• Experience building AI coding agents or code generation pipelines.

• Experience with LLM evaluation tools and frameworks.

Location and working arrangements

Offices in Tel Aviv and Ashdod. Initial onboarding will be on site, with greater flexibility afterward. Availability to start soon is required.