LLM Engineer

A startup in the FinTech and HealthTech sectors, developing a system designed to help companies reduce erroneous medical claim payments.

The company is based in Tel Aviv (near the train line), offers one work-from-home day per week, has 15 employees, and is experiencing growth.

Founded by a well-known Israeli venture capital firm, the company recently completed a significant Seed round.

Role overview:

• The role is part of the development team, working closely with Data Scientists. Responsibilities include:
• Developing, integrating, and implementing AI-driven solutions.
• Building and integrating LLM-based components and production-level AI pipelines.
• Implementing techniques such as RAG, Agentic Workflows, and Prompt Engineering within existing systems.
• Maintaining and optimizing AI services, connecting them to backend systems, and improving performance, latency, and accuracy in cloud environments.
• Working hands-on with Python and Machine Learning frameworks, LLM architectures, and AI infrastructure.
• Handling both model development and integration, with challenges including adapting models and developing agents to expand product capabilities.
• Technology stack: Python, ML/DL, LLM, RAG, Agentic Workflows, Prompt Engineering, AWS, GCP, Azure, Algorithms, Data Analysis, Data Enrichment, Model Optimization, Bias Detection, Overfitting, Concept Drift.

Requirements:

• 5+ years of software development experience.
• Hands-on experience with LLM and RAG development.
• Experience developing and deploying solutions in cloud environments.
• Proficiency in Python for production-level development.