Big Data Developer

JS 136 || Senior Data Engineer

SU, a leading company in its field in the Sharon region, invites a Senior Data Engineer to join its existing team of highly skilled data engineers and share a passion for turning data into actionable intelligence.

Responsibilities:

• Lead development projects for critical, high-availability, cloud-scale services and APIs.
• Support clients with large amounts of data, with scalability in mind.
• Develop and deploy real-time/batch data processing pipelines using the latest technologies.
• Design and build high-availability, cloud-scale data pipelines (ETLs).

Requirements:

• 3+ years of experience in large-scale, distributed server-side, and backend development using Scala, Node, Python, or Groovy - MUST.
• Bachelor's degree in Computer Science, Software Engineering, or a related field - MUST.
• Extensive experience in stream and batch BIG DATA pipeline processing using Apache Spark - MUST.
• Experience with Linux, Docker, and Kubernetes - MUST.
• Experience working with cloud providers (AWS, GCP) - MUST.
• Strong experience with event streaming platforms (like Kafka or its alternatives, such as Amazon MSK, Azure Event Hubs, or Confluent Cloud) - MUST.
• Experience in microservices architecture and flexible system design - MUST.

Nice to Have:

• Experience in stream and batch BIG DATA pipeline processing using Apache Flink.
• Experience with Airflow, Mongo, Elastic, HDFS, or similar technologies.1
• Experience with system monitoring (Prometheus, Influx, or similar).2
• Experience in independently managing development projects from scratch to production.3