Big Data Developer

A leading Hi-Tech company in the Ad-Tech industry is developing a website that aggregates the ten most accurate results based on Google search. The role is part of a team reporting directly to the CTO.

The company's product provides a simple solution for decision-making processes.

The technological stack includes JAVA, PYTHON, AWS, Spark, Kafka, Hive Metastore, Airflow, and Iceberg.

Being an established and stable company, it has generated hundreds of millions of dollars in revenue in the past year.

Located in Tel Aviv (near the train line), the company operates on a hybrid work model, allowing employees to work both from the office and remotely on a daily basis. The company has a workforce of 400 employees.

Requirements:

• 5 years experience in Scala/Java or equivalent language.

• Experience with Python.

• Proven experience in building, optimizing, and maintaining large-scale big data pipelines using popular open-source frameworks (Spark, Kafka, Hive Metastore, Airflow, Iceberg, etc).

• Strong SQL abilities and hands-on experience with SQL and NoSQL DBs.

• Experience with AWS cloud services such as EMR, Redshift/Snowflake, S3, Athena, and Glue - advantage.

• Experience in stream processing frameworks such as Flink - advantage.

• Exceptional Team Collaboration: Demonstrated ability to work effectively in a team environment, contributing to a collaborative work culture that fosters innovation.

• Ownership and Initiative: Strong ability to own and drive solutions from concept to completion