Data Engineer Team Lead

Upstream is looking for a hands-on Data Engineer Team Lead with a strong technical background in data infrastructure to join our Data Engineering & Data Science Group.

The Data Engineering & Data Science Group is a rapidly expanding team of skilled engineers. By joining them, you’ll have the opportunity to make a meaningful impact in shaping our data platform and contributing to the group’s strategic roadmap.

In this role, you’ll be responsible for the professional and personal development of your team. You’ll lead the technological strategy, build the tech agenda, work closely with the product, data-analysts and data-scientists, and drive your team to be accountable owners of their work as they meet company business goals.

This role is full-time and is based in Herzliya, Israel.

Requirements:

A data-oriented mindset
7+ years of development experience, using a general purpose programming language (Python, Java, Scala, Kotlin, Go, etc)
5+ years of experience in data engineering - designing & building data pipelines, analytical tools, and data lakes
3+ years in a leadership role
Great interpersonal skills - a team player who is communicative and empathetic
Vast experience with Python - Big Advantage
deep experience in SQL/NoSQL databases and data lakes
Vast experience with the data engineering tech stack: ETL & Orchestration tools (e.g. Airflow, Argo, Prefect) and data processing tools (e.g Spark, Kafka, Presto, Iceberg, dbt)
Experience working in a containerized environment (e.g. k8s ) - advantage
Experience building and maintaining ML infrastructure - big advantage

Upstream is an equal opportunity employer. All candidates for employment will be considered without regard to race, color, religion, sex, national origin, physical or mental disability, veteran status, or any other basis protected by applicable federal, state or local law.

Responsibilities:

Build, lead, coach, and mentor the data engineering team
Dedicate 70% of your work to hands-on development
Manage the agile delivery life-cycle and the team’s CI/CD pipelines
Ensure coding standards and implementation of best practices by conducting design and code reviews
Lead an innovative roadmap considering cutting edge technologies and open source frameworks
Collaborate with engineers, data architects, data analysts, and data scientists to develop solutions using a use case-driven approach, guiding the design and implementation of technical data flows
Build and expand our data infrastructure, including our data lake, analytics engine, orchestration tools and batch processing frameworks
Enhance and scale our ML platform, and automate the machine learning lifecycle