Data Engineer

Description

Our growing data infrastructure startup has around 20 employees based in central Tel Aviv. We are developing a data transformation platform that unlocks unstructured data sources for enterprises using LLMs.

Looking for strong engineers that like challenges at the cutting edge of systems that have LLMs and ML at their core, on diverse and large scale data sources.

Roles and Responsibilities

Build scalable data ingestion, transformation, and storage pipelines

Develop efficient ETL workflows using tools like Airflow and Prefect

Create data APIs and services for the transformation platform

Integrate machine learning models into production systems

Optimize infrastructure and system performance

Help design and implement machine learning systems

Leverage unstructured data sources to derive insights and drive product innovation

Collaborate with the algorithms team to productionize ML components

Create infrastructure for training, fine-tuning and serving LLMs at a large scale

Requirements

4+ years of Python/Data Engineering experience

Proficiency with cloud platforms (GCP, AWS), data warehousing, and ETL tools

Strong programming skills in Python and experience with SQL

Past experience working with data pipelines, APIs, and distributed systems

Knowledge of containerization and orchestration (Kubernetes)