Lead Test & Automation Engineer

About us

Chamelio is revolutionizing legal tech with an AI-powered Legal Intelligence Platform trusted by some of the world's fastest-growing companies, including Wiz, Socure, Appsflyer and Monday. We help in-house legal teams accelerate negotiations, reduce risk, and unlock institutional knowledge through automated workflows.

About the job

We're looking for a Head of Testing & Automation to establish our quality foundation from the ground up and build the team around it. You'll define how we test everything, from core product functionality to the behavior of the LLMs and agentic workflows at the heart of our platform. This is a hands-on, player-coach role: you'll write the first automation frameworks and evaluation systems yourself, then hire and grow the team that scales them. If you want to own quality end-to-end at a fast-moving AI company and build something from scratch, we want to hear from you.

What You'll Do

Establish Chamelio's testing and automation strategy from the ground up - frameworks, tooling, standards, and processes

Build automated test suites across the stack, from backend APIs & AI Agents to React frontends

Design and build evaluation systems for LLM-powered features and agentic workflows - accuracy, reliability, regression, and quality over time

Own CI/CD test integration, ensuring quality gates that keep our high-velocity shipping fast and safe

Hire, mentor, and grow a testing and automation team as we scale

Partner with engineers, AI researchers, and product to embed quality throughout the development lifecycle

Stay hands-on - write code, review tests, and set the technical bar by example

What You'll Bring

Passion to own and deliver - you take full responsibility for quality and drive initiatives from idea to production

Curiosity and adoption of AI coding tools - you actively use tools like Cursor or Claude Code and are excited about how AI is transforming software development

7+ years of professional experience in test automation, QA engineering, or SDET roles

Strong programming skills in Python, with the ability to build test frameworks and tooling from scratch

Deep experience with automated testing across backend and frontend systems

Experience with CI/CD pipelines and integrating automated testing into deployment workflows

A builder's mindset — comfortable establishing process and structure where none exists

Strong communication and leadership skills, effective in a fast-paced startup environment

Bonus Points

Experience testing or evaluating LLM-powered applications, agentic systems, or non-deterministic AI outputs

Familiarity with AWS infrastructure and cloud-native architectures

Experience building a QA or automation function from scratch, especially as a founding or first quality hire

Background working with legal, financial, or other high-stakes document-heavy domains

Our Tech Stack

Python, TypeScript, React.js, FastAPI, PostgreSQL, MongoDB, Redis, AWS, LLMs

Why Chamelio?

Make an impact: Your work will transform how legal teams at leading companies worldwide operate

Ship fast: Work in a lean, high-velocity environment where you see your work in production quickly

Own your work: Take full ownership of meaningful projects from conception to deployment

Grow with us: Join early and shape both the product and company as we scale

Tel Aviv | Full Time