Product Engineer

About Comet

Comet is building the development platform for teams who want to ship robust, reliable, and responsible AI applications. Opik, our open source LLM evaluation framework, has quickly become one of the most popular tools in the space. Our experiment management platform is used by data scientists at companies like Uber, Netflix, and Etsy. Tens of thousands of researchers, engineers, academics, and hobbyists use Comet every day to build the future of AI.

Working at Comet will give you access to the most exciting work being done in all areas of machine learning. Some of the top researchers and companies working on self-driving cars, drug discovery, particle research, diffusion models, and LLMs use Comet every day. Your work has the potential to accelerate the development of some of the most impactful technology in the world, and you will be doing it alongside a team of passionate, caring individuals. If that sounds exciting, Comet is the right place for you.

Comet is backed by more than $63 million in venture capital funding and powers some of the best machine-learning teams in the world, including Netflix, Uber, Etsy, and Mobileye. We are a remote-first company with offices in New York City (USA) and Tel Aviv (Israel).

You Are

We are seeking a talented Product Engineer to join our team and help build the Opik product! Opik is an open-source platform designed to streamline the entire lifecycle of LLM applications, helping developers evaluate, test, monitor, and optimize their models and agentic systems.

Ready to shape the future of LLM development? Join us in building the next generation of AI observability tools!

Responsibilities

• Build & ship features at high pace in a fast-moving AI development environment
• Develop and maintain comprehensive observability tools for LLM applications and RAG systems
• Create intuitive user interfaces for LLM tracing, evaluation dashboards, and production monitoring
• Build robust APIs and backend services to support real-time LLM application monitoring
• Collaborate with AI researchers and ML engineers to implement cutting-edge evaluation methodologies
• Contribute to both frontend (React/TypeScript) and backend (Python/Java) components
• Design and implement automated evaluation systems and "LLM as a Judge" capabilities
• Work on integrations with popular LLM frameworks and libraries
• Participate in open-source community engagement and technical documentation
  
  

• Experience: 4+ years of full-stack development experience, preferably in AI/ML domains
• AI Development Tools: Hands-on experience with AI-assisted coding environments, IDEs, and agent-based workflows (e.g., Cursor, Windsurf, GitHub Copilot, Codex, Claude Code, and similar platforms)
• Model Knowledge: Deep understanding of different AI model capabilities, limitations, and appropriate use cases (GPT-5, Claude, Gemini, etc.)
• Frontend Development: Expertise in TypeScript, React, and modern web development practices
• Backend Development: Strong proficiency in Python and/or Java with frameworks like Dropwizard
• Database & Infrastructure: Knowledge of scalable database design and containerization
• Observability Tools: Experience with tracing, monitoring, and evaluation systems
• Collaboration: Strong communication skills for working in a distributed, global team environment
• Problem Solving: Ability to work in ambiguous environments and solve complex technical challenges
  
  

• Open Source: Experience contributing to or maintaining open-source projects
• AI/ML Experience: Understanding of Large Language Models, RAG systems, and AI application architectures
  
  

• Experience with model evaluation, prompt engineering, and LLM optimization
• Knowledge of distributed systems and high-throughput data processing
• Familiarity with ML experiment tracking and model monitoring platforms
• Experience with DevOps practices and CI/CD pipelines
• Understanding of AI safety, model security, and responsible AI practices
  
  

• Competitive salary, based on proven experience, skills and location.
• Competitive benefits package.
• Flexible working hours and remote/Hybrid work options.
• Opportunities for professional growth and development.
• A collaborative and innovative work environment.
• The chance to work with cutting-edge technologies and projects.
• This role will be located in Tel Aviv, Israel (with hybrid flexibility) or in Europe (fully remote), working with a global team (large presence in the US, Tel Aviv and Europe), some flexibility with work hours is required to collaborate across time zones.