Data Engineer - Billing Platform

We are looking for a Data Engineer to join our usage metering & billing platform team! with a strong background in writing ETLs and complicated data processing pipelines. Youre deeply familiar with modern data processing stack (especially Spark, Hadoop and Airflow), have a strong problem-solving attitude and, most importantly, youre passionate about understanding the business side of the platform. Our platform engineers have an end-to-end understanding of the data our products generate and the commercial models and data structures in which they fit.
Working with this enormous volume of data begins with massive ETL pipelines built using cutting-edge technologies such as Kafka, BigQuery, Airflow, S3, PostgreSQL, Athena, SQS, Redis, and especially Spark. We are big believers in working with the right tool for the right job, including programming languages. We run a truly polyglot shot with Scala, Python, Go and Node being especially common here . The extreme growth rate of our data and

דרישות:

3-5 years of experience in data engineering in Big Data environments
2+ years of experience with Spark and its ecosystem.
Experience using JVM stack, build tools, and environment (We mostly use Scala)
Experience with public cloud environments (AWS will be a bonus), Hadoop ecosystem, SQL and NoSQL databases
High proficiency with Python and at least one JVM-based language (Scala, Java, or Kotlin)
Proficiency with SQL and experience with ETL and data modeling and development
Positive attitude and willingness to take ownership
A mindset of continuous learning and the desire to try new things
Ability to see the "big picture" and to understand the business side of things המשרה מיועדת לנשים ולגברים כאחד.