Big Data Engineer

We are looking for a passionate and highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a proven track record in developing and maintaining scalable, high-performance distributed systems. They should be enthusiastic about working with cutting-edge technologies in an Agile environment, with a strong foundation in software development and a deep understanding of distributed systems.

Responsibilities:

• Design & Development: Architect, develop, and maintain robust distributed system with complex requirements, ensuring scalability and performance.
• Collaboration: Work closely with cross-functional teams to ensure the seamless integration and functionality of software components.
• System Optimization: Implement and optimize scalable server systems, utilizing parallel processing, microservices architecture, and security development principles.
• Database Management: Effectively utilize SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databases in system design and development.
• Big Data Tools: Leverage big data tools such as Spark or Flink to enhance system performance and scalability
• (experience with these tools is advantageous).
• Deployment & Management: Demonstrate proficiency in Kubernetes (K8S) and familiarity with GTP tools to ensure efficient deployment and management of applications.

Qualifications:

• Education: Master’s or Bachelor’s degree in Computer Science or a related field.
• Experience: Minimum of 3 years of software development experience, including at least 2 years as a Senior Software Engineer using GoLang.
• Technical Expertise: Strong knowledge of the software development lifecycle, Agile methodologies, DevOps practices, CI/CD pipelines, and test automation.
• Skills: Proficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis, and column store databases. Experience with Spark or Flink is a plus.
• Tool Proficiency: Proven experience with Kubernetes (K8S); familiarity with GTP tools is an advantage.
• Leadership: Demonstrated ability to lead and mentor a team, with strong interpersonal skills and a collaborative, team-oriented mindset.
• Innovation: Ability to independently explore and implement new technologies.
• Language Skills: Fluency in Hebrew and English.
• Work Environment: Comfortable working in a fast-paced, startup-like environment.