Big Data Developer

Rise offers fully programmatic media solutions for publishers, empowering them to make informed business decisions through advanced data-powered solutions and AI models. Our platform seamlessly integrates with their content and enhances the user experience. With advancements perfectly tailored to meet advertising needs, publishers are enabled to maximize both revenues and profits.

We are currently looking for a talented Big Data Developer to join our DevOps & Data Infra Team and play a pivotal role in building and maintaining the foundational backend services, tooling, and automation for Rise's Ad Serving Platform.

In this dynamic and collaborative environment, you will work with cutting-edge technologies to manage a large volume of data, operate at a significant scale, and handle substantial traffic. Your key responsibilities will include overseeing data pipelines and infrastructure, as well as automating and enhancing current workflows in both production and development environments.

Responsibilities:

• Collaborate with data teams in order to understand how to optimize their processes
• Devise creative solutions to problems and either implement them yourself or work with other teams to do so.
• Support and optimize existing processes with limited guidance
• Provision and maintain cloud providers data infrastructure.
• Assist group members in creating efficient queries
• Monitor data production environments

Requirements​:

• At least 3 years of experience as a Big Data Developer- MUST!
• Hands on experience with data warehouses like: BigQuery, Redshift - MUST!
• Experience at AWS cloud platform and its data lake formation and stack: S3, Airflow, Glue, EMR, Redshift, RDS, EC2, VPC
• Coding proficiency in Python programming languages
• Solid knowledge of Apache Airflow or alternative ETL tool
• Strong knowledge and experience with Apache Spark and Presto
• Production experience with managing data pipelines and streaming tools such as Kafka, MSK or Kinesis.
• Deep understanding of structuring and querying data using Structured Query Language (SQL)

Advantages:

• Knowledge of GoLang programming language
• Hands-on experience with IAC tools like: Terraform, Cloudformation, Pulumi
• Experience with vector databases like: neo4j, aws Neptun etc.