Senior Big Data Engineer

Wa are seeking for a Senior Big Data Developer to join our engineering team, contributing to the construction of robust, scalable data solutions. Responsibilities include designing, developing, and implementing core components such as data lakes, pipelines, and orchestration tools, utilizing modern big data architectures and frameworks. This full-time role is based in Herzliya, Israel.

Requirements:

• Minimum 3 years of hands-on experience in designing and constructing data pipelines, analytical tools, and data lakes.
• Over 5 years of solid development background with a versatile programming language (e.g., Java, Scala,Kotlin, Go).
• Proficient in utilizing data engineering technologies, encompassing ETL & orchestration tools (e.g., Airflow, Argo, Prefect), and data processing tools (e.g., Spark, Kafka, Presto).
• Essential expertise in Python.
• Desirable experience with open-source solutions and operating within containerized environments (e.g., k8s).

Responsibilities:

• Develop foundational data infrastructure, including data lakes, analytics engines, and processing frameworks.
• Establish automated pipelines for data ingestion and processing into analytical platforms.
• Design and maintain data lake and warehouse architectures for efficient data access and analytics.
• Build and automate machine learning platforms and drive ML projects from an engineering perspective.
• Develop and manage orchestration, governance, and data discovery tools, collaborating with other engineering team members to provide tailored solutions based on technical data flows.