AI Automation Engineer

We are looking for an automation engineer to lead the evaluation and quality efforts of our ML algorithms and services.
As part of the role you will design and implement both automatic and manual tests for evaluating the quality of our data and ml algorithms.
What You Will Do:
Set, design and implement quality standards and processes.
Design and implement automated tests and visualisations to run periodically and/or upon updates
Define and conduct tests to ensure the quality of algorithms services in terms of run time, integration, error handling and scale under different environments and constant changes.
Define and conduct tests to ensure the accuracy of algorithms in production.
Identify weak spots and monitor algorithms stability in order to ensure the service hits its objectives for a wider range of systems and longer periods of time as data drifts.
Adopting and incorporating third-party open source libraries e.g. for evaluating LLMs.
Monitor our production systems and be the POC for issues.