Lead Test & Automation Engineer

Chamelio is revolutionizing legal tech with an AI-powered Legal Intelligence Platform trusted by some of the world's fastest-growing companies, including Wiz, Socure, Appsflyer and Monday. We help in-house legal teams accelerate negotiations, reduce risk, and unlock institutional knowledge through automated workflows.

About the job:

We're looking for a Head of Testing & Automation to establish our quality foundation from the ground up and build the team around it. You'll define how we test everything, from core product functionality to the behavior of the LLMs and agentic workflows at the heart of our platform. This is a hands-on, player-coach role: you'll write the first automation frameworks and evaluation systems yourself, then hire and grow the team that scales them. If you want to own quality end-to-end at a fast-moving AI company and build something from scratch, we want to hear from you.

What You'll Do:

• Establish Chamelio's testing and automation strategy from the ground up - frameworks, tooling, standards, and processes
• Build automated test suites across the stack, from backend APIs & AI Agents to React frontends
• Design and build evaluation systems for LLM-powered features and agentic workflows - accuracy, reliability, regression, and quality over time
• Own CI/CD test integration, ensuring quality gates that keep our high-velocity shipping fast and safe
• Hire, mentor, and grow a testing and automation team as we scale
• Partner with engineers, AI researchers, and product to embed quality throughout the development lifecycle
• Stay hands-on - write code, review tests, and set the technical bar by example

What You'll Bring:

• Passion to own and deliver - you take full responsibility for quality and drive initiatives from idea to production
• Curiosity and adoption of AI coding tools - you actively use tools like Cursor or Claude Code and are excited about how AI is transforming software development
• 7+ years of professional experience in test automation, QA engineering, or SDET roles
• Strong programming skills in Python, with the ability to build test frameworks and tooling from scratch
• Deep experience with automated testing across backend and frontend systems
• Experience with CI/CD pipelines and integrating automated testing into deployment workflows
• A builder's mindset - comfortable establishing process and structure where none exists
• Strong communication and leadership skills, effective in a fast-paced startup environment

Bonus Points:

• Experience testing or evaluating LLM-powered applications, agentic systems, or non-deterministic AI outputs
• Familiarity with AWS infrastructure and cloud-native architectures
• Experience building a QA or automation function from scratch, especially as a founding or first quality hire
• Background working with legal, financial, or other high-stakes document-heavy domains

Our Tech Stack :

Python, TypeScript, React.js, FastAPI, PostgreSQL, MongoDB, Redis, AWS, LLMs

Why Chamelio?

Make an impact: Your work will transform how legal teams at leading companies worldwide operate

Ship fast: Work in a lean, high-velocity environment where you see your work in production quickly

Own your work: Take full ownership of meaningful projects from conception to deployment

Grow with us: Join early and shape both the product and company as we scale