Big Data Developer

A company in the field of Data that develops AI-based technology and smart algorithms enabling app owners to reach their most relevant user audience through real-time interest prediction and massive-scale data analysis.

As part of a new team formation led by the CTO, the team will be developing a new product slated to replace an existing one.

The product involves handling vast amounts of data, with a scale of tens of TB per day in real-time. They work with Spark, Kafka streaming, Flink, Kinesis, AWS Python.

The company is located in Tel Aviv near a train station. Incorporating a hybrid work model with two days per week working from home.

Requirements-

• 4 years of proven experience as a Big Data Engineer

• Experience with at least one streaming technology: Spark structured streaming, Kafka streaming, Flink etc.

• Experience with designing and building ETL processes and data pipelines

• Experience with mission critical real-time systems.

• Good Analytical skills in SQL