QA Automation Engineer

About The Role

Scalefox builds Dana, an AI assistant that handles real communication on behalf of busy operators — replying to email and WhatsApp, managing calendars, and keeping commitments from slipping. When the assistant acts on someone's behalf, quality is not optional. We're looking for a QA Automation Engineer to own the automated testing that keeps those AI-driven flows trustworthy as we ship fast.

You'll work directly with the engineers building Dana, designing the test strategy for conversational and agentic flows that are non-deterministic by nature, and turning flaky manual checks into reliable automated coverage.

What you'll do

• Design and build end-to-end automation for web and API flows using Playwright and pytest.
• Create test harnesses for AI-agent behavior — evaluating Dana's responses, tool calls, and guardrails across realistic scenarios.
• Own the regression suite and wire it into CI so every pull request is gated on green.
• Build and maintain API-level integration tests against our FastAPI backend.
• Triage failures, file precise reproductions, and partner with developers to drive fixes.
• Define quality metrics and make test results visible to the whole team.
  
  

• 3+ years in QA automation or a software role with heavy testing ownership.
• Strong scripting in Python or JavaScript/TypeScript.
• Hands-on experience with a modern E2E framework (Playwright, Cypress, or Selenium).
• Solid grasp of API testing, HTTP, and CI/CD pipelines (GitHub Actions a plus).
• A sharp eye for edge cases and the patience to make non-deterministic systems testable.
• Fluent English; Hebrew is a plus.
  
  

• Experience testing LLM or AI-driven products and evaluating model outputs.
• Familiarity with Postgres, Docker, and cloud environments (AWS).
• Performance and load testing experience.