Quality Assurance Automation Engineer

Checksum is looking for a QA Testing Automation Engineer with a twist.

Alongside implementation of tests for our system's various components, the position also involves designing and implementing benchmarks for AI processes, evaluating the performance of LLM prompting and exploring different variations to improve results, preparing data for ML training processes, etc. The common denominator of all these efforts is to ensure the best possible outcome for our customers.

About us

Checksum is building the next generation of AI-powered end-to-end testing for web applications and is designing a new experience allowing auto-generation and seamless integration and maintenance of such tests. As we've shown in a recent survey, E2E tests are critical to web-based companies, which despite the complexity of building and maintaining them, invest considerable resources in doing so ultimately preventing bugs and enabling them to ship faster.

The position

You will

1. Manually test system components and overall functionality

2. Implement test automation 

3. Plan and perform benchmarks for several processes

4. Evaluate and improve performance of LLM prompting 

5. Review and prepare data for ML training

You must

1. Have at least 2 years experience programming with Javascript/Typescript

2. Be familiar with testing frameworks like Jest, Cypress, Playwright, Selenium, etc

3. Be able to analyze complex datasets and process logs, and extract actionable insights

4. Have tried to prompt an LLM (using chat GPT for example) to achieve certain work/personal goals

Important skills for the job include critical thinking, analytical capabilities, fluent written and spoken English.