Software Engineer - Data Ingestion

Description:

Coralogix is a modern, full-stack observability platform transforming how businesses process and understand their data. Our unique architecture powers in-stream analytics without reliance on expensive indexing or hot storage. We specialize in comprehensive monitoring of logs, metrics, trace and security events with features such as APM, RUM, SIEM, Kubernetes monitoring and more, all enhancing operational efficiency and reducing observability spend by up to 70%.

We are seeking engineers with hands-on experience in developing and managing distributed systems and microservices in a production environment. The ideal candidate should have a solid background in infrastructure and operations.

The team builds high-throughput ingestion and processing pipelines, efficient storage on object stores, and systems for data governance, usage reporting, and routing data to multiple physical locations.

You will work on cloud-native, production systems written in Rust and Scala, operating at scale with Kafka, Postgres, Redis, and object storage, run on Kubernetes and operate in a multi-cloud environment.

Responsibilities

• Develop and operate distributed systems in production
• Build Kafka-based ingestion and processing pipelines
• Design systems for data governance, retention, deletion, and usage reporting
• Work with Postgres and Redis, requiring solid database design and operational knowledge
• Implement efficient persistence using column-oriented data formats and object storage

• Located in Israel
• 5+ years of software development experience
• Production experience with large-scale Apache Kafka or comparable distributed data streaming platforms
• Strong understanding of distributed systems, databases, and production operations
• Experience with Scala or Rust or other JVM
• B.Sc. in Computer Science or an equivalent field

Advantages

• Experience with Kafka Streams or similar frameworks
• Experience with column-oriented data formats and large-scale analytical storage systems
• Experience with Apache Arrow and DataFusion

Cultural Fit

We’re seeking candidates who are hungry, humble, and smart. Coralogix fosters a culture of innovation and continuous learning, where team members are encouraged to challenge the status quo and contribute to our shared mission. If you thrive in dynamic environments and are eager to shape the future of observability solutions, we’d love to hear from you.

Coralogix is an equal opportunity employer and encourages applicants from all backgrounds to apply.