Big Data Developer

A startup in the Threat Hunting field is developing a system that enables security teams to detect attackers, even those who leave no traces. The company is funded with $118 million raised in 3 funding rounds from top investors and venture capital firms worldwide.

Located in Tel Aviv near the train station and offer up to 2 days of remote work.

Job description: Transition to development in Scala, Backend development in Scala, working with Spark, K8S, AWS, Snowflake.

About the role

• Work as a member of an Agile Scrum team to design, develop, and maintain detection and investigation content, large-scale data stream processing pipelines and backend components on top of Flink, K8S, and AWS.

• Improve existing tooling, APIs, and logging mechanisms for streamlined data processing.

• Collaborate on optimizing SQL queries for superior system performance and cost reduction.

• Share expertise with the Research team, contributing to a collaborative learning environment.

• Design, develop, and implement solutions to handle scaling with good performance & cost that are easy to maintain.

• Take a crucial part in content development to enhance the effectiveness of the threat detection and response capabilities.

• Collaborate with engineers across the R&D group and Product Managers to improve the platform.

• Develop and implement data quality checks to ensure accuracy and completeness of data and work on externalizing monitoring capabilities.

Requirements-

• 4 years of development experience in Python.

• Proven data engineering experience.

• Strong and proven experience in writing SQL, optimizing SQL queries for efficiency and speed, minimizing resource consumption, and ensuring cost-effectiveness in data processing.

• Experience with modern Data lakes/warehouses such as Snowflake, Databricks, etc.

• A demonstrated interest in the cybersecurity landscape, including a basic understanding of common threats and security principles.

• Strong collaborative skills, as the role involves working within a dynamic research team and contributing to developing cutting-edge cybersecurity solutions.

• Proven ability to independently solve problems, troubleshoot issues, and propose effective solutions.

• B.Sc. in computer science or equivalent