Big Data Engineer

Mertens-Malam Team is looking for a Big Data Engineer for a Leading Organization.

Job Description:

• Perform and oversee the integration, linking, and organization of diverse data sources.
• Develop, design, and manage data transportation and streaming solutions of various types, including the operation and management of the data pipeline in both Batch and real-time.
• Expertise in various information technologies with a strong emphasis on deep familiarity with different cloud environments and leading tools for handling and processing large volumes of data.
• Understand incoming data into the organizational data lake, extract valid data, package it into various physical and logical layers, catalog, and package it for use by data scientists.

Job Requirements:

• 4 years of experience as a Big Data Engineer
• Experience in system analysis, understanding client needs, and writing specifications
• Experience working with Python, SQL, SPARK, Azure DataBricks, Azure Data Factory
• Experience working with Azure Platform
• Experience with Azure Data Explorer, Azure EventHub - an advantage
• Familiarity with reporting tools, with an emphasis on Power BI - an advantage