Artificial Intelligence Engineer

We’re hiring an AI/LLM Infrastructure Engineer to lead the deployment, scaling, and operations of on-prem large language models and supporting infrastructure. You’ll own everything from GPU orchestration to retrieval pipelines, working across teams to productionize advanced LLM systems.

What You’ll Do

• Deploy, manage, and optimize on-prem LLM infrastructure (e.g. LLaMA, Mistral).
• Build and maintain vector databases and RAG pipelines.
• Design scalable AI/data pipelines and inference services.
• Fine-tune models and optimize prompt engineering strategies.
• Operate LLM services on Kubernetes with GPU scheduling.
• Monitor performance, implement CI/CD, and ensure system reliability.

What You’ll Need

• Hands-on experience with LLM frameworks (vLLM, HF Transformers, DeepSpeed).
• Strong K8s skills, including GPU orchestration.
• Experience with vector DBs (e.g. Weaviate, Qdrant, FAISS).
• Solid understanding of RAG systems and prompt engineering.
• Fluency in English and working proficiency in Hebrew.