Senior Data Engineer

Our growing data infrastructure startup has around 20 employees based in central Tel Aviv. We are developing a data transformation platform that unlocks unstructured data sources for enterprises using LLMs.

Looking for strong engineers that like challenges at the cutting edge of systems that have LLMs and ML at their core, on diverse and large scale data sources.

Roles and Responsibilities

• Build scalable data ingestion, transformation, and storage pipelines
• Develop efficient ETL workflows using tools like Airflow and Prefect
• Create data APIs and services for the transformation platform
• Integrate machine learning models into production systems
• Optimize infrastructure and system performance
• Help design and implement machine learning systems
• Leverage unstructured data sources to derive insights and drive product innovation
• Collaborate with algorithms team to productionize ML components
• Create infrastructure for training, fine tuning and serving LLMs at a large scale

Requirements

• 4+ years of Python/Data Engineering experience
• Proficiency with cloud platforms (GCP, AWS), data warehousing, and ETL tools
• Strong programming skills in Python and experience with SQL
• Past working with data pipelines, APIs, and distributed systems
• Knowledge of containerization and orchestration (Kubernetes)