Data Engineer

A Data-focused startup developing AI-based technology and advanced algorithms that enable app owners to reach the most relevant user audience by predicting interest in real-time and analyzing data at a massive scale.

Located in Tel Aviv, near a train station, they offer two days of remote work and currently have 75 employees.

Responsibilities:

• Design and implement advanced ETLs and high-throughput, fault-tolerant infrastructure.
• Focus on testing, CI/CD processes, and maintaining data quality.
• Research and evaluate new technologies, conducting proof of concepts.
• Implement new technologies based on research findings.
• Understand the data platform, including its business value and data lineage.
• Develop Big Data infrastructure, data pipelines, and ETLs.
• Use Python (or Java/Scala if no Python experience) with Spark and Airflow.
• Process tens of terabytes of data daily in a Linux and AWS environment.

Requirements:

• 5 years of hands-on experience as a Data/Backend Engineer.
• 3 years of experience skills with Python /Java / Scala.
• Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.
• Ability to lead activities and to work independently.
• Good Analytical skills in SQL.