Data Platform Engineering Team Lead

One of our clients, a leading technology company specializing in advanced machine learning solutions for mobile app growth, is seeking an experienced Data Platform Engineering Team Lead to join their team.

The team is responsible for the data lake's infrastructure, including significant and essential ETL processes, developing shared data frameworks, and creating Java management systems and additional monitoring tools.

Their machine-critical production systems require end-to-end DevOps operations, including evaluating external company POCs and extensive in-house system and process development.

Technologies: Python, AWS, SQL, Docker, Kubernetes, Firebolt, Airflow.

Responsibilities:

• Lead Data Projects: Manage data backend systems, pipelines, and data-serving projects from requirements to delivery.
• Architect Data Platform Components: Develop observability tools, metadata stores, data lineage tracking systems, and governance frameworks.
• Team Leadership: Mentor and lead the team, providing clear objectives and fostering professional development.
• Technology Strategy: Assess, implement, and integrate new technologies to enhance the data platform.
• Collaborate Across Teams: Provide technical guidance and ensure alignment with best practices and organizational goals.
• Data Lifecycle Expertise: Maintain a deep understanding of data collection, management, and consumption to inform solutions.

Qualifications:

• At least 8 years of experience as a Data Engineer or Backend Engineer with expertise in Python, Java, or Scala.
• Minimum 2 years of team leadership experience or significant project management expertise.
• Proven experience designing, building, and maintaining production-grade systems.
• Strong DevOps skills, including automated deployments and infrastructure management.
• Hands-on experience with ETL processes and technologies like Spark and Airflow (or similar tools).
• Proficiency with AWS, Docker, Kubernetes, and relational databases such as SQL.
• Background in engineering with exposure to large-scale data systems and cost optimization challenges.
• Production experience in end-to-end system monitoring, version control, and DevOps.

Preferred Skills:

• Strong analytical capabilities in SQL.
• Experience in building scalable data pipelines and frameworks.

Location: Tel Aviv - Rothschild

Hybrid Model: Two days working from home and three days from the office.

Number of employees: 80

Industry Focus:

Ad-Tech, Big Data, Machine Learning

This position reports to: Director of Data engineering