Senior Data Engineer

Join a highly prestigious organization and play a pivotal role in designing and implementing critical data systems that support national security operations. As a Senior Data Engineer, you will work with advanced technologies and collaborate with exceptional professionals to deliver impactful solutions.
This role offers a rare chance to contribute to mission-critical projects while deepening your expertise in Big Data, real-time streaming, and production systems within a high-stakes, rewarding environment.
Key Responsibilities
1. Data Pipeline Development
• Design and implement scalable pipelines for both batch and real-time data processing.
• Develop workflows to handle data ingestion, transformation, and delivery.
2. Big Data Technologies
• Build and optimize large-scale data processing systems using tools like Apache Spark or Hadoop.
3. Streaming Data Systems
• Develop and integrate real-time data solutions with platforms like Kafka or RabbitMQ.
4. Production Deployment and Monitoring
• Operate in production environments to ensure reliability, scalability, and performance.
• Collaborate with DevOps teams on CI/CD pipelines leveraging tools like Jenkins, Docker, or Kubernetes.
5. Collaboration and Security
• Partner with cross-functional teams to ensure data integrity and compliance with stringent security protocols.
Why Join Us?
• Work on impactful, mission-critical projects of national importance.
• Collaborate with highly skilled professionals in a respected and stable environment.
• Enjoy a competitive compensation package and long-term growth opportunities.
דרישות התפקיד
Mandatory Requirements
• 4+ years of hands-on experience with Python or Java.
• Big Data Technologies:
• Minimum 1 year of experience with Big Data frameworks, such as Apache Spark (preferred) or Hadoop.
• Streaming Systems:
• 3+ years of experience working with real-time platforms like Apache Kafka (preferred) or similar tools (e.g., RabbitMQ, Pulsar).
CI/CD and Production Systems:
• Familiarity with tools like Jenkins, Docker, or Kubernetes.
• Database Knowledge:
• Experience with relational databases (e.g., PostgreSQL) or non-relational databases (e.g., MongoDB, Cassandra).
________________________________________
Preferred Requirements
• Experience with cloud platforms like AWS, Azure, or GCP.
• Familiarity with workflow orchestration tools (e.g., Apache Airflow or Prefect).
• Basic knowledge of Infrastructure-as-Code (IaC) tools, such as Terraform or CloudFormation.