Senior Big Data Engineer

We are looking for Senior Data Engineer to join our innovative COMBATAI program at Netanya Site

The program aim is to produce world-class capabilities for structured & un-structured data, AI lifecycle management that will introduce a new way to empower value from data & AI

We're looking for a skilled Data Engineer to join our team. You'll work with bid data lakehouse & warehouse, focusing on Data pipeline automation methods. Your role involves technical leading of data structure for contextual pipelines, and SQL knowledge is a plus

Key Responsibilities

Build smart logic data pipelines for processing data, manipulating, and deriving insights from data

Collaborate with data stewards to define and build metadata schemes

Implement data FAAS and workflows for example: metadata generator, metadata auto-extraction, validation procedures according to schemes and taxonomy, format conversions and more

Develop tools for audit, observability, and compliance analytics

Date feature Analyzing raw data and organizing it for Interpreting trends and patterns

Conducting complex data analysis and reporting on results

Preparing data for prescriptive and predictive modeling

Exploring ways to enhance data quality and reliability , data fusion from different sources

Developing analytical tools, algorithms and programs

Collaborating with data scientists and architects on several projects

Explore new technologies, learn new skills, and apply concepts in new ways

Work side by side with our Big Data & AI engineers, build & share



B.sc in computer science or Data science

five years of hands-on experience as lead big data engineer

Experience in developing Big Data & AI solutions with tools and frameworks such as Apache Nifi, Kafka, Spark, Graph DB, NoSQL DB, Airflow, microservices, S3 object storage

Coding: Python, Bash

Experience with concepts of managing metadata & taxonomy beside big data objects – advantage

Experience with public cloud Big Data & AI services – advantage

Familiar with machine learning concepts – advantage

Great learner, open-minded and team player