Senior Data Engineer - Platform

Who We Are

Our team is responsible for the data and data infrastructure that processes billions of records daily, driving critical business insights for both internal and external customers across the organization.

Our Data team consists of highly skilled senior software and data professionals who collaborate to solve complex data challenges. We process billions of records daily from multiple sources using diverse infra and multi-stage pipelines with intricate data structures and advanced queries, and complex BI.

A bit about our infrastructure. Our main databases are Snowflake, Iceberg on AWS, and Trino. Spark on EMR processes the huge influx of data. Airflow does most of the ETL.

The data we deliver drives insights both for internal and external customers. Our internal customers use it routinely for decision-making across the organization, such enhancing our product offerings.

What You’ll Do

• Build, maintain, and optimize data infrastructure
• Contribute to the evolution of our AWS-based infrastructure
• Work with database technologies – Snowflake, Iceberg, Trino, Athena, and Glue
• Utilize Airflow, Spark, Kubernetes, ArgoCD and AWS
• Provide AI tools to ease data access for our customers
• Integrate external tools such as for anomaly detection or data sources ingestion
• Use AI to accelerate your development
• Assures the quality of the infra by employed QA automation methods
  
  

• 5+ years of experience as a Data Engineer, or Backend Developer
• Experience with Big Data and cloud-based environments, preferably AWS
• Experience with Spark and Airflow
• Experience with Snowflake, Databrick, BigQuery or Iceberg
• Strong development experience in Python
• Knowledge of Scala for Spark is a plus
• A team player that care about the team, the service, and his customers
• Strong analytical skills