Data Engineer

Our department is responsible for the application layer above the data, including all analytical and managerial systems built on top of integrated information. We transform the organization into a Data Hub by providing access to all data for comprehensive analysis, serving a wide range of business stakeholders across Data-Oriented projects. This is a fantastic opportunity to be part of a modern technological transformation!

Position Description:

We are looking for a skilled Data Engineer to develop end-to-end data pipelines in a Data Lake environment.

The role involves:

• Developing scripts in Python (with a focus on PySpark)
• Data development and analysis using SQL
• Conducting unit and integration tests
• Working on CI/CD processes
• Developing pipelines in Jenkins

Requirements:

• At least 1 year of experience in PySpark development
• At least 4 years of experience in SQL development (with an advantage for Data/BI expertise)
• Experience writing complex SQL queries
• Proficiency in Python, particularly with PySpark and Pandas libraries
• Knowledge of data analysis and ETL/ELT processes
• Experience working with Data Lakes and Data Warehouses (DWH)
• Familiarity with CI/CD processes
• Strong self-learning abilities