QA Engineer

What The Job Entails

Notch's autonomous AI agents handle real customer conversations at scale - and that means quality isn't optional, it's existential.

As our QA Engineer, you'll build QA infrastructure that ensures our product meets the highest bar, and you’ll be the first voice advocating for quality at every stage of development. You'll design and execute comprehensive test strategies across our platform's most critical workflows, from escalation rules and automation audit configurations to the AI agent behaviors that power our customers' support operations.

This is a hands-on, high-impact role. You'll work tightly with developers, product managers, and designers to catch bugs before they ship - and to build the processes and automation that prevent them from appearing in the first place.

What You'll Bring

• A quality-first mindset: you see QA not as a gate at the end of the pipeline, but as a discipline embedded in every phase of product development.
• The ability to make sharp risk-based decisions -you know when a 2% repro-rate bug in a non-critical feature is a release note vs. a release blocker.
• Experience establishing or maturing QA processes in teams that may not have had formal QA before.
• Comfort navigating the tension between speed and quality - you can articulate trade-offs to stakeholders and push back on pressure to skip testing when the risk warrants it.
• A collaborative, empathetic approach to working with developers you build trust, not friction.
  
  

• Design, maintain, and execute comprehensive test suites -including functional, regression, integration, smoke, performance, and exploratory tests -across Notch's AI platform.
• Build and expand automated test coverage using Playwright and Typescript, integrated into our CI/CD pipeline.
• Collaborate with developers throughout the SDLC: participate in sprint planning, review requirements for testability, join design reviews, and validate acceptance criteria before development begins.
• Own the QA process for key product areas, including escalation configurations, automation audit rules (email patterns, subject lines, message keywords), and AI agent behavior customization.
• Investigate, document, and triage bugs with detailed, reproducible reports -and advocate for the right balance between blocking a release and shipping with known issues.
• Debug web application issues using browser DevTools, network analysis tools, and API testing utilities.
• Champion a testing culture across the engineering organization - quality is everyone's responsibility, and you help make that real through process, tooling, and collaboration.
• Proactively identify subtle bug classes- race conditions, off-by-one errors, timezone issues, Unicode handling, caching inconsistencies -and build test strategies specifically targeting them.
• Evaluate and recommend improvements to QA tooling, processes, and infrastructure as the team and product scale.
  
  

• 4+ years of QA experience in a SaaS or web application environment, with a strong understanding of the SDLC and where QA fits within it.
• Hands-on experience designing test plans and test suites - from smoke tests and regression suites to edge-case and exploratory testing.
• Proficiency with test automation tools such as Selenium, Cypress, Playwright, or similar frameworks.
• Experience with test management platforms like TestRail, Zephyr, Xray, or qTest.
• Comfortable using browser developer tools, network inspectors (Wireshark, Fiddler, Charles Proxy), and API testing tools (Postman, REST-assured).
• Solid understanding of web technologies: HTTP/HTTPS, REST APIs, WebSockets, HTML/CSS, and JavaScript basics.
• Proficient with modern AI-tool based software development (e.g Cursor, Claude Code).
• Familiar with CI/CD pipelines and how automated tests integrate into build and deployment workflows.
• Strong analytical mindset -you think in edge cases, race conditions, and boundary values, not just happy paths.
• Excellent written and verbal communication skills; you can write a clear, reproducible bug report that developers love you for.
• Product-focused mindset -you understand that "working as designed" doesn't always mean "working well."
  
  

• Experience testing AI/ML-powered features or conversational AI systems.
• Familiarity with network protocols beyond HTTP -WebSocket debugging, SMTP, DNS -and the tools to troubleshoot them.
• Background in performance or load testing (k6, JMeter, Locust).
• Experience with security testing or OWASP awareness.
• Contributions to open-source testing tools or frameworks.
• Knowledge of accessibility testing (WCAG compliance).