Big Data Developer

Pipl is the identity trust company. Our solutions allow organizations to provide frictionless customer experiences and approve more transactions with greater confidence and speed. We use multivariate linking to establish deep connections among more than 330 billion trust signals—email, mobile phone and social media data that spans the globe—and then look at the big picture to derive identity trust.

We're looking for a Big Data Developer to play a key role in our Data Infrastructure team. If you have a passion for big-data and you enjoy tackling complex data challenges, this one's for you!

In your day-to-day, you'll define, shape, and evolve the architecture of large-scale data products. You'll be responsible for processing terabytes of data as well as building and maintaining production systems with sub-millisecond latency response time while targeting to reduce storage consumption as much as possible.

You will work with a strong team of big data developers. Additionally, you will be involved in researching, designing, and implementing robust systems that handle vast amounts of data, serving as the backbone of our search index. You'll also be part of a team that conducts POCs for new requirements and emerging technologies.

Requirements:

• 5 years of experience- as big data/ backend engineer
• Strong understanding of data warehousing, data lakes, and big data technologies
• Experience with Java, Spring and specifically with streaming
• Experience with python
• Experience with different DBs - MySQL and key/value DBs
• Experience with Google Cloud Platform (GCP) services such as BigTable, BigQuery, Cloud Dataflow, Cloud queue, and Cloud Dataproc, Google composer (Airflow)