Data Engineer

As a Data Engineer with a strong background in data integration, you will play a critical role in ensuring the seamless flow of data across various systems, databases, and applications. Your expertise in handling data pipelines and building efficient data architectures will be instrumental in transforming raw data into valuable insights for the organization. Additionally, you possess a keen interest in data science and aspire to develop your skills in this field.

• Data Integration and Pipeline Development: Design, build, and maintain robust data pipelines that connect diverse data sources, including databases, APIs, cloud platforms, and third-party systems. You will be responsible for data extraction, transformation, and loading (ETL) processes, ensuring data accuracy, consistency, and reliability

• Data Warehouse and Architecture: Collaborate with cross-functional teams to architect and optimize data storage and retrieval systems. Implement data warehousing solutions that support efficient data querying and analysis while adhering to best practices in data modelling

• Data Quality and Governance: Monitor data quality and establish data governance practices to maintain high data integrity. Work on data cleansing, data validation, and data profiling to ensure the accuracy and completeness of data

• Performance Tuning and Optimization: Continuously optimize data pipelines and database performance to enhance overall data processing efficiency. Identify and resolve bottlenecks and performance issues within the data infrastructure

• Integration Technologies and Tools: Stay updated with the latest data integration tools and technologies. Evaluate and recommend suitable tools and platforms to enhance data integration processes

Your skills & experience

• Bachelor's or Master's degree in Computer Science, Data Science, Information Systems, or a related field

• Proven experience as a Data Engineer, with a strong focus on data integration and ETL processes

• Proficiency in Python

•Proven experience with Spark is a Must

• Knowledge of data governance, data security, and data privacy principles

• Excellent problem-solving skills and the ability to troubleshoot and resolve data-related issues

• Strong communication and collaboration skills to work effectively with cross-functional teams, including data scientists, analysts, and business stakeholders