Data Engineer

Location: Israel

Job Description:

We are seeking a Data Engineer to join our R&D team to develop and maintain a robust platform of the data pipeline and data warehousing, that collects and aggregates millions of monthly events.

You will own a key area of AU10TIX data structure, responsible for collecting, integrating and serving all aspects of data used internally for the business to keep growing.

Responsibilities:
Build and maintain ETL pipelines in Azure Data Factory
Build and maintain real-time data processing in Azure stream analytics
Synapse dedicated SQL pool maintenance and optimization
Investigate unusual trends in the raw data and start reverse engineering to find the root cause
Provide support to the business analysts by creating an aggregation table used later for Power BI reports
Maintain python notebook in Synapse Analytics
Manage and maintain current billing API connection and add new billing features as needed
Requirements:
2+ years working as a data engineer, managing and building etl
Good knowledge of SQL for data querying and data manipulation
Experience with Azure Data Factory/ Azure Synapse Analytics
Python knowledge- Advantage
Problem-solving and independent thinking.
Self-learner and Passion for data and strong analytical skills
Ability to quickly and independently learn new technologies, frameworks, and algorithms.
Very good English, written and verbal.