Automation Engineer

An elite Innovation Department within a global leader in Digital Intelligence and Forensics. The company develops mission-critical solutions for law enforcement agencies worldwide, specializing in data extraction and analysis.

This department acts as an internal AI powerhouse, developing GenAI solutions to empower teams across the entire organization.

A global corporation with thousands of employees. Located in the Central District (near the train station), operating a hybrid work model with two days per week from home.

Role Overview:

• Serving as the first QA/Automation lead within a multidisciplinary AI Innovation team.
• Taking end-to-end ownership of the quality and evaluation of LLM-based GenAI applications.
• Building automation infrastructures from scratch (aiming for 100% automation) using Python and Playwright.
• Designing sophisticated evaluation strategies for AI systems, including Prompt Regression, Multi-turn Conversations, and Reasoning Failures.
• Creating Evaluation Datasets to identify and mitigate Hallucinations and complex logic failures.
• Performing API Testing and SQL-based data validation within data-heavy environments.

Requirements:

• 2 years of experience in Automation Development.
• Proven experience in both Manual and Automation testing methodologies.
• Strong proficiency in Python – a must.
• Hands-on experience with Playwright – a must.
• Solid experience with SQL for data validation.
• Mandatory background in at least one of the following: GenAI, LLMs, Chatbots, RAG, LangChain/LangGraph, or ML.
• Ability to work independently and define QA processes for non-deterministic AI systems.