Data Engineer

• Data Integration and Pipeline Development: Design, build, and maintain robust data pipelines that connect diverse data sources, including databases, APIs, cloud platforms, and third-party systems. You will be responsible for data extraction, transformation, and loading (ETL) processes, ensuring data accuracy, consistency, and reliability.
• Data Warehouse and Architecture: Collaborate with cross-functional teams to architect and optimize data storage and retrieval systems. Implement data warehousing solutions that support efficient data querying and analysis while adhering to best practices in data modeling.
• Data Quality and Governance: Monitor data quality and establish data governance practices to maintain high data integrity. Work on data cleansing, data validation, and data profiling to ensure the accuracy and completeness of data.
• Performance Tuning and Optimization: Continuously optimize data pipelines and database performance to enhance overall data processing efficiency. Identify and resolve bottlenecks and performance issues within the data infrastructure.
• Integration Technologies and Tools: Stay updated with the latest data integration tools and technologies. Evaluate and recommend suitable tools and platforms to enhance data integration processes.
דרישות התפקיד
• Bachelor's or Master's degree in Computer Science, Data Science, Information Systems, or a related field.
• Proven experience as a Data Engineer, with a strong focus on data integration and ETL processes.
• Proficiency in programming languages like Python, Java, or Scala for data manipulation and integration tasks (Python is preferred).
• Strong understanding of data modeling concepts and database technologies such as SQL, NoSQL, and Big Data solutions.
• Familiarity with data integration tools and cloud-based data platforms, such as Databricks, AirFlow, Kafka, Spark, AWS, Glue – a Must.
• Knowledge of data governance, data security, and data privacy principles.
• Excellent problem-solving skills and the ability to troubleshoot and resolve data-related issues.
• Strong communication and collaboration skills to work effectively with cross-functional teams, including data scientists, analysts, and business stakeholders.