Data Engineering Team Lead

Upstream is looking for a hands-on Data Engineering Team Lead with a strong technical background in data infrastructure to join our Data Engineering & Data Science Group.

The Data Engineering & Data Science Group is a rapidly expanding team of skilled engineers. By joining them, you’ll have the opportunity to make a meaningful impact in shaping our data platform and contributing to the group’s strategic roadmap.

In this role, you’ll be responsible for the professional and personal development of your team. You’ll lead the technological strategy, build the tech agenda, work closely with the product, data-analysts and data-scientists, and drive your team to be accountable owners of their work as they meet company business goals.

This role is full-time and is based in Herzliya, Israel.

Responsibilities:

• Build, lead, coach, and mentor the data engineering team
• Dedicate 70% of your work to hands-on development
• Manage the agile delivery life-cycle and the team’s CI/CD pipelines
• Ensure coding standards and implementation of best practices by conducting design and code reviews
• Lead an innovative roadmap considering cutting edge technologies and open source frameworks
• Collaborate with engineers, data architects, data analysts, and data scientists to develop solutions using a use case-driven approach, guiding the design and implementation of technical data flows
• Build and expand our data infrastructure, including our data lake, analytics engine, orchestration tools and batch processing frameworks
• Enhance and scale our ML platform, and automate the machine learning lifecycle
  
  

• A data-oriented mindset
• 7+ years of development experience, using a general purpose programming language (Python, Java, Scala, Kotlin, Go, etc)
• 4+ years of experience in data engineering - designing & building data pipelines, analytical tools, and data lakes
• 2+ years in a leadership role
• Great interpersonal skills - a team player who is communicative and empathetic
• Vast experience with Python - Big Advantage
• deep experience in SQL/NoSQL databases and data lakes
• Vast experience with the data engineering tech stack: ETL & Orchestration tools (e.g. Airflow, Argo, Prefect) and data processing tools (e.g Spark, Kafka, Presto, Iceberg, dbt)
• Experience working in a containerized environment (e.g. k8s ) - advantage
• Experience building and maintaining ML infrastructure - big advantage