Team Lead – Data Engineering | Python & Big Data Expert

Data Engineering Team Lead to join our Data & AI Platform team.

In this role, you’ll lead the development of scalable data ingestion and analytics pipelines, collaborating closely with our platform architect and cross-functional teams. You’ll drive innovation and help shape the future of our data and AI capabilities.

What You’ll Do:

• Lead and mentor a team of skilled data engineers.
• Develop and maintain scalable data ingestion pipelines using Python.
• Work with Spark, Kafka, Delta Lake, and other modern data technologies.
• Collaborate with architects and stakeholders to design robust data solutions.
• Enhance analytics capabilities and extend team knowledge and practices.
• Ensure system scalability, performance, and reliability.

Requirements:

• 5+ years of hands-on experience in Python, specifically in Data Engineering.
• Proven experience with Apache Spark, Kafka, Delta Lake/Open Table formats.
• Strong knowledge of SQL and NoSQL databases.
• Familiarity with Java, Microservices architecture, and Kubernetes (K8s).
• Hands-on experience with Databricks and Delta format.
• Strong leadership and communication skills.