Senior Big Data Engineer

Who are we
we are an Israeli-founded big data analytics company (Stock: NYSE: DV). We track and analyze tens of billions of ads every day for the biggest brands in the world.
We operate at a massive scale, handling over 100B events per day and over 1M RPS at peak, we process events in real-time at low latencies (ms) and analyze over 2.5M video years every day. We verify that all ads are fraud free, appear next to appropriate content, appear to people in the right geography and measure the viewability and users engagement throughout the ads lifecycle.
We are global, with HQ in NYC and R&D centers in Tel Aviv, New York, Finland, Berlin, Belgium and San Diego. We work in a fast-paced environment and have a lot of challenges to solve. If you like to work in a huge scale environment and want to help us build products that have a huge impact on the industry, and the web - then your place is with us.
What you will do
You will work in a team of data and backend engineers producing user attentiveness insights and recommendations that help big brands optimize their digital advertising strategy.
You will process 10s of billions of records a day using mainly Python and Scala, utilizing advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks and GCP managed solutions.
You will build data pipelines that integrate with internal and external data sources from various platforms to enhance business insights while keeping standards high with testing, automated deployment and high degree of observability.
You will be responsible for defining solutions and delivering them while collaborating with engineering & product teams on productionizing & monitoring your solutions.
You will explore, implement and support multiple data initiatives and projects at the same time.