Big Data Developer

Our Purpose

We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Title And Summary

Big Data Developer

Who is Mastercard?

Mastercard is a global technology company in the payments industry.

Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making

transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships

and passion, our innovations and solutions help individuals, financial institutions, governments,

and businesses realize their greatest potential.

Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our

company. With connections across more than 210 countries and territories, we are building a

sustainable world that unlocks priceless possibilities for all.

Overview

Dynamic Yield by Mastercard is looking for a senior Big Data developer with strong OOP capabilities, a deep understanding of distributed systems and the ability to deliver in a technically diverse and fast-paced environment.

As part of the team, you’ll be responsible for developing Dynamic Yield’s Affinity capabilities which are some of our most popular and valuable offerings, equiping our customers with our new cutting-edge predictive technology.

Over the past year, we've integrated the AffinityML algorithm into our arsenal for profiling users, and we're currently developing an automated pipeline for model training and delivery to our clients.

We use the latest and strongest frameworks such as Spark, Flink, Airflow, Akka, Cassandra, Redis and Elasticsearch, running on k8s.

Role

• Design, build and maintain our affinity algorithms - both batch and stream processing
• Be fully responsible for the product’s lifecycle - from design and development to deployment
• Monitor and optimize the performance of big data systems and infrastructure
• Collaborate with data scientists, analysts, and other stakeholders to design and implement data models and analytics pipelines
• Stay up-to-date with emerging technologies and industry trends related to big data and distributed computing
• Bring a strong opinion to the table and be proactively involved with product planning
• Troubleshoot and resolve data issues
  
  

• At least 4 years of software development experience
• At least 3 years of experience in big data engineering or a related field
• Experience with Big Data/NoSQL/Stream processing technologies (e.g Spark, Kafka, Flink, Redis)
• Strong programming skills in Java, Scala, Python or other programming languages
• Proven experience in leading and delivering complex software projects
• Working experience with Docker and Kubernetes
• Experienced in AWS cloud technologies and administration
• A passion for clean, robust code and performance tuning
  
  

• Abide by Mastercard’s security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.