Data engineer team lead

I'm hiring to a technology startup a Data engineering team leader located in Tel Aviv

What will you do?

• Build and maintain the company’s central data in-cloud platform.
• Own the data architecture: ETL, Pipelines, Databases, Data integrations, and more.
• Continuously maintain a healthy and up-to-date data tech stack, guaranteeing scalability and robustness.
• Understand the organization's data needs and provide solutions to other data stakeholders, such as data analysts, engineers, and product managers.
• Produce state-of-the-art data engineering development methodologies, including code reviews, monitoring, tests (unit, component), infra as code, ci/cd, and more.
• Provide expert-level technical leadership and mentoring to the team.
• Collaborate with Analysts and Business Stakeholders on data requirements and functional specifications.
• Take leading roles in projects such as search engine ranking, promoted ads in VIDAA's search results, recommendations, user segmentation and personalization, text analysis, real-time predictions, live streaming data handling, exploration-exploitation problems, etc.
• Independent research and innovation in new content and technological domains.

What do we need?

• 5+ years of hands-on experience as a BI Developer/Data Engineer- a mus
• 2+ years of R&D managerial experience- a must
• BA/BSc in a related field (such as CS, engineering, information systems) or equivalent.
• High proficiency in SQL & Python - a Must
• Experience working with cloud DBs (Hive and/or Snowflake).
• Hands-on experience with developing end-to-end ETL/ELT processes.
• Proven experience with data warehousing, modeling paradigms, and architectures, proficient in DWH methodologies and best practices.
• Experience of the Hadoop framework (HDFS, EMR, HIVE, Presto) – A big advantage
• Familiar with Kafka, Confluent, Fluentd, Spark, and Airflow – a big advantage
• Experience with data visualization tools such as Tableau or Power BI – Advantage