Big Data Developer

A high-tech company specializing in Data develops AI-driven technology and smart algorithms that enable app owners to reach their most relevant audience. By predicting user interest in real-time and analyzing massive-scale data, the company delivers cutting-edge solutions.

Located in Tel Aviv, near a train station, the company offers a hybrid work model with two days of remote work per week. The team comprises approximately 75 employees.

Role Overview-

• This role focuses on developing Big Data infrastructure, data pipelines, and ETLs using Python (knowledge in Java or Scala is sufficient).
• You will work with technologies like Spark and Airflow, handling enormous data scales of tens of terabytes daily in a Linux and AWS environment.
• Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
• New technology due diligence, proof of concepts and implementation.
• Deep understanding of our data platform including business value and lineage.

Requirements:

• 5 years of hands-on experience as a Data/Backend Engineer.
• 3 years of experience skills with Python /Java / Scala.
• Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.
• Ability to lead activities and to work independently.
• Good Analytical skills in SQL.