Data and AI Lead

We are a rapidly growing company at the forefront of revolutionizing how security teams manage and process data. We're seeking a highly skilled Engineer to join our CTO team and be a major part of our next generation developments. If you have a passion for data, security, and AI, have extensive data engineering expertise, and thrive in solving complex challenges, we want you to play a key role in shaping the future of our innovative product.

Responsibilities:

• Innovate and build POCs of the next generation of features
• Guide and Architect data pipelines and solutions in Seemplicity using robust data pipelines and ETL processes using distributed frameworks and tools.
• Make informed decisions on tradeoffs between data processing approaches, performance, cost and value.
• Understand the problem domain from our product and analyst teams to adjust the backend model and systems accordingly.
• Leverage expertise in cloud platforms and managed services to find solutions that are as efficient and simple as possible.
  
  

• Proven experience (8y+) in Building data pipelines & Solutions
• Strong understanding and experience (4y+) with Big data tech stack, including SQL\NoSQL databases, batch\stream processing data warehouses (e.g., Snowflake, Redshift, Databricks, Clickhouse).
• Built solutions with AI and specifically LLMs in its core
• Proven experience with big data frameworks, such as Spark, Flink, Airflow, Kafka.
• Proficient in DevOps tools, including Docker, Kubernetes, Terraform or other equivalents.
• Strong communication skills, ensuring effective collaboration and adapting communication methods based on project requirements.