Big Data Engineer

A premier Data-Intelligence firm and a category leader in the digital transformation of global infrastructure. Backed by significant Tier-1 venture capital, the company has developed a first-of-its-kind platform that integrates IoT sensory hardware and AI to capture real-time data from complex industrial sites.

By converting physical operations into high-fidelity digital insights, the organization provides the "source of truth" for large-scale enterprise efficiency.

Led by executives from world-class technology giants, the company maintains an elite R&D center in Tel Aviv and operates under a hybrid work model.

Responsibilities-

• Architecture & Modeling: Designing and implementing robust, scalable Data Models to support complex, high-velocity IoT and sensor-based datasets.
• Pipeline Engineering: Developing high-performance Data Pipelines from scratch to handle massive data flows from international sites.
• Data Integrity Ownership: Taking full responsibility for Data Quality, ensuring that mission-critical insights delivered to global enterprise clients are accurate and reliable.
• Research Empowerment: Building the infrastructure and environments necessary for Data Scientists and Researchers to conduct advanced modeling and analysis.
• Modern Data Stack: Leveraging a cutting-edge environment based on Databricks, Spark, and Kafka to process large-scale structured and unstructured data.
• Cloud-Native Excellence: Managing and automating data environments on AWS, utilizing modern Infrastructure-as-Code practices.

Requirements-

• 5 years of experience as a Data Engineer, specifically within high-scale or high-complexity environments – Mandatory.
• Deep hands-on experience in development with Spark (PySpark / SQL) – Mandatory.
• Proven experience working with Databricks for data engineering and analytics at scale – Mandatory.
• Significant experience building and managing data architectures on AWS – Mandatory.
• Proficiency with Kafka for real-time streaming and familiarity with Terraform or similar orchestration tools.