QA Engineer

About Tavily

We're building the search engine for AI agents. Our API is designed from the ground up to power RAG and real-time reasoning in AI systems. By connecting LLMs to high quality, trustworthy web content, we help developers build agents that are not only intelligent, but also informed.

We work with some of the most innovative teams in AI, from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.

The Role

We're looking for a QA Engineer to own quality across our AI-powered search infrastructure. You'll work closely with engineering to ensure our APIs, scraping pipelines, and AI-driven features meet the highest standards. This role goes beyond traditional QA—you'll be testing non-deterministic AI outputs, building automation frameworks, and helping define quality metrics for LLM-integrated systems.

What You'll Do

• Design and execute test strategies for our search API, content extraction, and AI-powered research features
• Build and maintain automated testing frameworks for APIs, microservices, and data pipelines
• Develop testing approaches for non-deterministic AI outputs (LLM responses, search relevance, content quality)
• Create performance and load testing suites to ensure our systems scale reliably
• Collaborate with developers to implement CI/CD quality gates and shift-left testing practices
• Investigate production issues, perform root cause analysis, and define preventive measures
• Define and track quality metrics across our distributed system
  
  

• 3+ years of experience in QA Engineering, with strong emphasis on backend/API testing
• Hands-on experience with test automation frameworks (pytest, Playwright, or similar)
• Experience testing distributed systems, microservices, or data pipelines
• Familiarity with AI/ML systems and the challenges of testing non-deterministic outputs
• Strong understanding of REST APIs and experience with API testing tools
• Experience with CI/CD pipelines and integrating automated tests
• Familiarity with cloud environments (AWS preferred)
• Strong debugging and analytical skills
• Excellent communication in English (written and verbal)
• You're excited about an in-person office environment in Tel Aviv
• Nice to have: Experience with Elasticsearch, MongoDB, or similar data stores; exposure to LLMs and prompt engineering
  
  

• A young, open, and inclusive culture where everyone has real impact from day one
• The chance to build alongside a fast-moving team at the forefront of agentic AI
• Full medical and dental coverage
• A deep-work culture that values curiosity, creativity, and continuous learning
• Monthly Cibus