Data Engineer

**העסקה ישירה על ידי הלקוח- עובד/ת חברה מהיום הראשון**

As a Data Platform Engineer, you will join our data platform team, working alongside data engineers, backend engineers, and analysts and BI team.

In this crucial role, you will take part in building our next-generation data platform. as data-driven company. You will collaborate with different departments to expose them to data sources that shed light on every aspect of our product, including user behavior, new feature adoption, operational, financial, marketing KPIs, and more.

You will work with cutting-edge data technologies and address the business needs of other department members based on an in-depth understanding of our business.

Responsibilities

End-to-end development of company data infrastructure

Build and develop high-performance, near real-time ETL/ELT processes incorporating Airflow, AWS, Kubernetes, Databricks, Spark, and Kafka

Build data architecture to enable clients to produce and consume data using SQL or programmatic.

Drive the collection of new data and refine existing data sources

Develop, implement, and maintain change control and testing processes

Design and build monitoring tools

Implement data pipelines and data architecture that are scalable, fault-tolerant, and support high throughput and low latency, while considering security aspects at all times

Requirements:

3+ years of experience in Data Engineering role or similar

3+ years of Python experience with the ability to understand other languages - a must

Experience working with and deploying distributed data technologies - Airflow, DBT (or similar), etc. - a must

Experience in working with cloud providers (GCP, AWS)

Experience with data lakes & data warehouses in the cloud (S3, Redshift, Cloud storage, Athena)

Proven experience working with SQL and NoSQL databases

Ability to build and deliver working software through iterative, agile processes

Experience with ETL processes, data integration, data modeling and data warehouse