Data Engineer

A startup company in the field of Data, which develops AI-based technology and smart algorithms that enable app owners to reach their most relevant user base by predicting real-time interests and analyzing data on a massive scale.

Located in Tel Aviv near a train station, incorporating remote work on a daily basis. Currently employing 75 employees.

Role Overview: Developing big data infrastructure, data pipelines, and ETLs in Python with Spark, airflow, handling immense scale of tens of TB per day in a Linux, AWS environment.

Responsibilities:

• Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.

• New technology due diligence, proof of concepts and implementation.

• Deep understanding of our data platform including business value and lineage.

Requirements:

• 5 years of hands-on experience as a Data/Backend Engineer.

• 3 years of experience skills with Python /Java / Scala.

• Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.

• Ability to lead activities and to work independently.

• Good Analytical skills in SQL.