Big Data Developer

A successful and profitable company in the Data field, developing AI-based technology and smart algorithmics that enable app owners to reach their most relevant user base by predicting real-time interests and analyzing immense data on a massive scale.

A new team is being formed under the leadership of the CTO to develop a new product that will replace an existing one. This product involves vast amounts of data, processing tens of TBs daily in real-time. Working with Spark, Kafka streaming, Flink, Kinesis, AWS Python.

The company is based in Tel Aviv near a train station and incorporates two remote working days. The team consists of 75 employees.

Requirements-

• 3 years of proven experience as a Big Data Engineer

• Experience with at least one streaming technology: Spark structured streaming, Kafka streaming, Flink etc.

• Experience with designing and building ETL processes and data pipelines

• Experience with mission critical real-time systems.

• Good Analytical skills in SQL.