Data Engineer BIG DATA גוש דן

We're hiring a Data Engineer for a financial organization located in Tel Aviv (Hybrid model).

Job Description

A fast-growing Data and ML engineering group in a financial institution located in Tel Aviv seeks out a Machine learning engineer (MLE)/python developer.

In this role you will work closely with data scientists and provide them with solutions to a wide range of needs, such as Python packages development, Rest API services development and data pipelines development.

A key factor in this position is a production orientation and providing a generic and scalable solutions both for batch and API processes.

The preferred candidate will have a broad knowledge and working experience in:

• Strong coding abilities in Python and experienced in code review
• Knowledge of CICD pipelines
• Data pipelines – design and build data infrastructure for data extraction, preparation, and loading of data from a variety of sources
• Automation, quality checks and monitoring processes
• Solid infrastructure view
  
  

• 6+ years of developing experience with Python
• 4+ years of experience with Git/Gitlab and Jenkins
• 3+ years of Rest API development including fast API
• 2+ years of working experience with containers, Kubernetes, openShift
• 3+ years of coding with SQL and query optimization in MS-SQL/MySQL/Postgres etc.
• 2+ years of working experience with NoSQL database such as Hbase, mongoDB or Cassandra.
• 2+ year experience with Hadoop ecosystem components: HDFS, Hive, Spark
• Kafka or other messaging queues – advantage
• 2+ years of experience with Shell scripts – advantage
• 2–5 years of experience in applied AI/ML or AI solution integration.
• Experience with AWS services and AI services – s3 , aws bedrock , aws transcribe
• Experience using OpenAI / Azure OpenAI / HuggingFace APIs