Data Engineer

The position includes planning and managing integration processes, operating data pipelines, data preparation and refinement processes (DATA CLEANZING, and replication. Defining and executing access, production, flow, inclusion and absorption processes between data sources and analytical platforms, providing training and guidance to developers and data engineers in the organization.

Taking part in building work processes, methodologies and architecture adapted to the world of model development, data and the corporate work environment.

Providing solutions and maintaining HIGH PERFORMANCE and HIGH AVAILABILITY in large volumes of information, on structured and unstructured information at the required speed. Working in collaboration with the organization's DBA and infrastructure, integrators and external vendors. Checking and defining infrastructure requirements according to the planned activity. Consulting and support for users in query languages ​​according to different databases and tools. Participating in the planning of DATA transition processes to a cloud environment.

Qualifications

• 5 years of experience in building work methodologies with complex data at a high level.
• Experience in delineating ways of modeling, information transfers and information architecture. Experience managing data engineers.
• Experience in processes for extracting data from large databases and turning them from raw data into useful information, including insights that help decision-making, using tools such as built-in Python and SQL BI tools. Data management including creation, update and deletion. Identify, analyze and detect trends in large databases using complex statistical methods. Forming recommendations and insights regarding products and processes in the office, including passing them on to the product and development people
• Experience working with analytical tools, BI, ETL processes - mandatory
• Mastery on Python - mandatory