Data Engineer

Company Description

Leumi is Israel one of the leading and largest corporations in the Middle East. The Leumi Group operates 268 branches throughout Israel and has branches and offices in key financial centers worldwide. Leumi provides a wide range of high-quality banking services to households, small and middle-market businesses, and large corporations, backed by professionalism and high standards. In recent years, Leumi has significantly enhanced its technological capabilities to offer advanced banking services. Today, 'Leumi Digital' leads the digital banking sector in Israel, offering innovative online banking services accessible through various platforms, including the internet, social media, smartphones, tablets, digital stations, and ATMs.

Role Description

This is a full-time hybrid role for a Data Engineer. The role is located in Lod.

The Data Engineer will be responsible for designing, developing, and managing data pipelines, data modeling, and building data warehousing solutions on AWS envierment for an AI specialist team.

Qualifications

• Minimum 3 years of hands-on experience with Python.

• Practical experience with Apache Spark for large-scale data processing.

• At least 2 years of hands-on experience with AWS services, including Athena, Glue, Step Functions, EMR, Redshift, and RDS.

• Strong expertise in design, development, and optimization of complex data solutions that transfer and process large volumes of data.

• Deep understanding of data optimization techniques and working with partitions across various data formats such as Parquet, Avro, HDF5, and Delta Lake.

• Experience with Docker, Linux, CI/CD tools, and Kubernetes.

• Hands-on experience with data pipeline orchestration tools such as Apache Airflow or Kubeflow.

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or Statistics.

• Understanding of machine learning concepts and workflows.

• Familiarity with Generative AI solutions and prompt engineering – an advantage, but not required