Data Engineer

A fast-growing Data and ML engineering group seeks out a Machine learning engineer (MLE)/python developer.

In this role you will work closely with data scientists and provide them with solutions to a wide range of needs, such as Python packages development, Rest API services development and data pipelines development.

A key factor in this position is a production orientation and providing a generic and scalable solutions both for batch and API processes.

The preferred candidate will have a broad knowledge and working experience in:

1. Strong coding abilities in Python and experienced in code review

2. Knowledge of CICD pipelines

3. Data pipelines - design and build data infrastructure for data extraction, preparation, and loading of data from a variety of sources

4. Automation, quality checks and monitoring processes

5. Solid infrastructure view

Understating of machine learning and data science Methodologies - big advantage

Technical skills required:

6+ years of developing experience with Python

4+ years of experience with Git/Gitlab and Jenkins

3+ years of Rest API development including fast API

2+ years of working experience with containers, Kubernetes, openShift

3+ years of coding with SQL and query optimization in MS-SQL/MySQL/Postgres etc.

2+ years of working experience with NoSQL database such as Hbase, mongoDB or Cassandra.

2+ year experience with Hadoop ecosystem components: HDFS, Hive, Spark

Kafka or other messaging queues - advantage

2+ years of experience with Shell scripts - advantage

2-5 years of experience in applied AI/ML or AI solution integration.

Experience with AWS services and AI services - s3 , aws bedrock , aws transcribe

Experience using OpenAI / Azure OpenAI / HuggingFace APIs

Ideally the best fit will be highly motivated with a strong self-learning ability, well organized, team player with a can-do attitude who isn't afraid of a challenge and learning new technologies.