Data Engineer

A startup in the data field has developed an AI platform capable of gathering information about individual product purchases from millions of diverse records across the internet. This includes websites of marketing networks, marketplaces, and more. The system processes and correlates the data with sales information, providing insights into why people buy certain products, trends, and more.

Recently, they secured significant funding and already have international clients.

The role involves leading a team of 5 data professionals, reporting to the Head of Research and Development.

Responsibilities include developing data pipelines in Python, working with Spark and Airflow in the GCP environment. The team generates business insights from the platform for their clients and is responsible for all data infrastructure, collaborating closely with DevOps and DS teams.

The company is located in Tel Aviv, near a train station, and follows a hybrid work model of three days in the office. They employ 30 workers.

Requirements-

• 4 years of experience in data or backend engineering, preferably with Python proficiency for data tasks.

• Demonstrated experience in designing, developing, and delivering sophisticated data applications

• Ability to thrive under pressure, consistently delivering results, and making strategic prioritization decisions in challenging situations.

• Hands-on experience with data pipeline orchestration and data processing tools, particularly Apache Airflow and Spark.

• Deep experience with public cloud platforms, preferably GCP, and expertise in cloud-based data storage and processing.

• Bachelor's degree in Computer Science, Information Technology, or a related field or equivalent experience.