Senior Software Engineer (Agentic Search) - Web Access Engineer

About Tavily

We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.

We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.

The Role

We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.

In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.

Your Responsibilities Will Include

• Research and analyse how modern websites communicate with browsers across the complete request lifecycle
• Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access
• Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation
• Translate technical research into production systems operating at internet scale
  
  

• Chromium architecture and browser internals
• Browser lifecycle and navigation
• Chrome DevTools Protocol (CDP)
• Playwright, Puppeteer, Selenium, or similar browser automation frameworks
• Browser instrumentation and debugging
  
  

• HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking
• Cookies, browser storage, caching, redirects, and session management
• JavaScript execution and modern client-side rendering
• Resource loading, page lifecycle, and browser networking
• Browser fingerprinting concepts and browser characteristics
  
  

• Experience working on browser engines or browser infrastructure
• Experience reverse engineering browser or web application behaviour
• Experience building internet-scale distributed systems
• Go, C++, Rust, or Python
• Kubernetes and cloud infrastructure
  
  

• Full ownership — small team, you own the entire infrastructure, not a slice of it
• Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests
• AI-native company — your infra directly powers AI agents used by leading companies in the space.