Big Data Engineer

A premier Israeli Cyber Research & Development center is expanding its elite data engineering division. Specializing in high-stakes, large-scale projects for the Israel Defense Establishment and the National Intelligence Community, the organization operates at the absolute frontier of cyber warfare and intelligence technology.

The company is located in Central Israel and operates an in-office work model. Due to the nature of the projects, candidates must undergo a Security Clearance process.

Role Overview:

• Technical Leadership: Serving as the professional lead for a multidisciplinary pod (including Analysts, Developers, and Data Engineers), driving the technical strategy and execution of complex data initiatives.
• Architecture & Design: Leading the design and implementation of high-performance Data Pipelines within a sophisticated, secure On-Premise environment.
• End-to-End Engineering: Developing robust, scalable data solutions using Python, ensuring seamless data flow and integration for advanced cyber research.
• Orchestration & Routing: Managing and optimizing complex workflows and data movement using Airflow and NiFi.
• Data Infrastructure: Architecting and maintaining large-scale data stores, including MongoDB and Elasticsearch, to support real-time intelligence analysis.
• Collaborative R&D: Reporting to the Team Lead and working closely with elite research units to translate operational requirements into advanced engineering solutions.

Requirements:

• 7 years of professional experience as a Big Data / Data Engineer – Mandatory.
• 3 years of hands-on experience in Python development – Mandatory.
• Proven experience in developing and orchestrating workflows with Airflow – Mandatory.
• Strong expertise in Elasticsearch, Splunk, or MongoDB – Mandatory.
• Extensive experience with NiFi or similar data routing/integration tools – Mandatory.
• Deep understanding of On-Premise infrastructure and high-scale data architectures.
• Professional leadership capabilities and a proactive, "lead-by-example" approach.
• Ability to undergo a full Security Clearance process – Mandatory.