Automation Lead

Firmus, powered by Bluebeam, is the leading AI platform for pre-construction design review and risk analysis, helping construction teams, detect design-related issues through intelligent document analysis.

Recently acquired by The Nemetschek Group through its subsidiary Bluebeam, we're uniquely positioned at the intersection of startup agility and enterprise scale.

Automation and Data tools Lead The Team You'll join a lean, high-impact engineering team building a scalable AI engine that processes millions of construction plans to to build a comprehensive construction knowledge graph.

We're on a mission to rebuild our main engine from scratch, with tight CI/CD principals ,and handling non-deterministic AI outputs.

This is a unique opportunity to work with the speed and creativity of a startup while leveraging the resources, customer access, and market reach of a multi-billion dollar global enterprise.

Key Responsibilities:

• This is senior hands-on role, reporting to VP R&D.
• Design our test automation strategy for AI/ML-powered applications and implement it from scratch.
• Build data processing tools for our data scientists and data ops teams.
• Build test automation frameworks supporting web, API, and AI model testing
• Establish testing standards and best practices for functional, integration, and end-to-end testing Create specialized testing approaches for AI model accuracy, performance, and reliability validation Establish quality gates and release criteria for both software and AI model deployments.

Required Qualifications:

• 5+ years of experience in test automation with 2+ years in leadership roles.
• Experience building Test automation frameworks from scratch, in SaaS companies.
• Strong proficiency in test automation frameworks (Selenium or Playwright)
• Expertise in API testing tools (Postman, REST Assured, Karate)
• Strong programming skills in Python, JavaScript or Go.
• Understanding of databases, APIs, and microservices architectures
• Excellent communication skills for cross-functional collaboration Preferred Qualifications Experience with model testing frameworks and ML model evaluation metrics