Senior Data Engineer

⭐ We are looking for a Lead Big Data Engineer ⭐

Come join our CTO Developer Experiences Platform Team and lead the implementation of our vision- to build Data Lake House & MLOps on the AWS cloud.

You have an amazing opportunity to be part of the revolution and build Generative AI products and services.

We are looking for builders who are not afraid to explore the unknown and take big risks with new tech!

Responsibilities :

- Plan and build Data Lake House in the AWS cloud.

- Design, develop, deploy, measure and maintain our data platform.

- Research and build Generative AI services and applications.

- Collaborate Data engineers/Scientists

- Communicate complex architectural concepts and recommendations effectively

- Participate in the software engineering, processes and standards with an impact on the whole delivery organization.

Requirements :

- 5+ years of experience as Data Engineer.

- Experience with Big Data tools and developing large scale distributed data systems and services.

- Experience working with AWS Cloud and services: RDS, SPARK, Glue, OpenSearch and more.

- Expertise in the Software design and architecture process.

- Experience with SQL and No-SQL.

- Experience working with programming languages: Python, Java, or Scala.

- Good understanding and experience of CI/CD practices and Git, including MLOps practices.

☑️ Our Tech Stack :

Python, Java, Spark, Kafka, Parquet, IceBerg, Avro, AWS S3, AWS Glue, AWS Athena, AWS DataZone, AWS Lake Formation, AWS SageMaker, AWS Document DB, AWS ElasticCahe, AWS OpenSearch, AWS DRS, AWS QuickSight, AWS EKS, AWS Managed Airflow.