AI Automation Engineer

WSC Sports AI based products are used for automatic content creation that impacts millions of sport fans around the globe. Our AI teams create innovative algorithms using cutting edge technologies.

We are looking for an automation engineer to lead the evaluation and quality efforts of our ML algorithms and services. As part of the role you will design and implement both automatic and manual tests for evaluating the quality of our data and ml algorithms.

What You Will Do

Set, design and implement quality standards and processes.
Design and implement automated tests and visualisations to run periodically and/or upon updates
Define and conduct tests to ensure the quality of algorithms services in terms of run time, integration, error handling and scale under different environments and constant changes.
Define and conduct tests to ensure the accuracy of algorithms in production.
Identify weak spots and monitor algorithms’ stability in order to ensure the service hits its objectives for a wider range of systems and longer periods of time as data drifts.
Adopting and incorporating third-party open source libraries e.g. for evaluating LLMs.
Monitor our production systems and be the POC for issues.

Requirements:

Required Skills

B.Sc in computer science / relevant engineering
2+ years of experience in Python development
Understanding of statistics (Advantage)
Independent, proficient, autodidact
Experience with developing and maintaining tests framework
Experience with relational SQL database
Understanding of QA processes: test case planning, feature ownership, automation reporting and triage, bug reporting, regression & isolation

Example for concrete Tasks

Magicrop / Audio Piracy / Auto-Press / Recap new systems or ongoing data evaluation tool
Run a regression test for every new version of a model (e.g. S2T, Subtitle)
Create an automation to run a stress test for any new model
Facilitate the evaluation of the recap service (with operations)

Work Model:
Hybrid