Senior Data Engineer

Bigabid is an innovative technology company led by data scientists and engineers devoted to mobile app growth. Our proprietary ad platforms powered by machine learning are the outcome of that devotion.

We deliver valuable results and insights for a fast-growing clientele of major app developers using elite programmatic user acquisition and retargeting technologies.

Our ever evolving, state-of-the-art machine learning technology analyzes 50TB of raw data per day to produce millions of ad recommendations in real-time. This data is used to power our machine learning predictions, business critical metrics, and analytics to power our decision making.

We are seeking a Senior Data Engineer to promote and maintain our unique data processing platform. You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing. The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.

Responsibilities:

• Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
• New technology due diligence, proof of concepts and implementation.
• Deep understanding of our data platform including business value and lineage.
  
  

• +5 years of hands-on experience as a Data/Backend Engineer.
• +3 years of experience skills with Python /Java / Scala.
• Experience with designing and building ETL processes / data pipelines using spark and airflow or similar technologies.
• Ability to lead activities and to work independently.
• Good Analytical skills in SQL.
  
  

• Cloud native architecture with advantage to AWS.
• Knowledge of Linux operating systems.
• Good knowledge in containerization.