Senior Data Engineer

Description:

Silverfort is on a mission to bring identity security everywhere – to every human, machine, and AI agent, both on-prem and in the cloud.

Our unique technology secures identities & access at runtime, in ways that weren’t possible before. With the broadest identity security platform in the market, trusted by more than 1,000 customers including many Fortune 100 companies, Silverfort is uniquely positioned to lead the fast-growing identity security category.

Joining Silverfort means becoming part of a fast-moving team with a culture of innovation and collaboration, that goes above and beyond to help our customers and each other, on a journey to reshape the future of identity security.

We are seeking a Senior Data Engineer to join our R&D organization as part of a backend-oriented team, responsible for building and scaling the core data infrastructure.

In this role, you will design and develop data pipelines that stream and process data directly from production systems. You will play a key role in shaping our data platform, building robust, scalable infrastructure and pipelines using modern technologies, and working hands-on with both new components and existing systems.

• Collaborate as a strong team player within a dynamic, cross-functional environment
• Design, develop, and maintain scalable data models, Lakehouse architectures, pipelines, and ETL processes
• Enhance data workflows to support efficient real-time and batch processing
• Work closely with cross-functional teams to understand data requirements and deliver impactful solutions
• Stay up to date with the latest data engineering technologies and best practices, continuously improving our data platform

• 6+ years of development experience, including at least 3 years as a Data Engineer
• Experience with distributed computing frameworks (e.g., Spark, Flink, EMR)- Must
• Experience with Iceberg / Delta Lake / Databricks or similar technologies
• Experience designing scalable data storage solutions over object storage (structured and semi-structured data)
• Hands-on experience building data pipelines and ingestion systems (batch and/or streaming)
• Strong communication skills and ability to work with multiple stakeholders across teams
• Proficiency in Python and PySpark- Advantage
• Experience in streaming systems and real-time data processing- Advantage
• Background in backend engineering or experience working closely with backend teams- Advantage
• Experience optimizing data processing performance for cost and efficiency- Advantage