Data Engineer - Price Optimization

Department
AI
Type
Full-time
Level
Location
Israel
About The Position

Data Engineer

Fetcherr experts in deep learning, algo-trading, e-commerce, and digitization, Fetcherr disrupts traditional systems with its cutting-edge AI technology. At its core is the Large Market Model (LMM), an adaptable AI engine that forecasts demand and market trends with precision, empowering real-time decision-making. Specializing initially in the airline industry, Fetcherr aims to revolutionize industries with dynamic AI-driven solutions.

We're looking for a Data Engineer to help us grow our data engineering capabilities. The ideal candidate is a python engineer with a solid background in building data-intensive applications, familiar with industrial best practices who is self-driven, motivated, independent, and sharp.

You as a member of the data engineering team will take an active part in all development phases, including research, design, development, testing and deployment using technologies like Python, Dagster, Kubernetes, BigQuery, Clickhouse, Ray.

About The Position

You’ll be a great fit if you have:

B.Sc or Master’s degree in Computer Science or equivalent STEM degree
Strong Python programming skills, including:
3+ years of production experience
Working with highly parallel computations
Optimizing memory consumption
Optimizing IO operations at scale
Fluency in SQL and data modeling within both OLAP and OLTP databases
Vast experience in building ETL(ELT) pipelines with diverse architectures (streaming, batching) using any orchestration tools (i.e. Dagster, Airflow, Prefect, Luigi, etc.)
Fluent with commonly used data engineering libraries like pandas, pyarrow, numpy, Jinja, dbt
Hands-on experience in containerized environments (Docker, Kubernetes, Podman, etc.)
You’re a team player, ready to help others
Have a readiness and willingness to continuously learn while working
Readiness to work in stressful environment with strict deadlines and SLA’s

Nice to have:

Strong experience with Dagster
Practical experience with functional programming. Any language, conceptual knowledge is more important
Familiarity with cloud computing (ideally GCP)
Test-driven development mindset
Experience with CI/CD tooling i.e. GitlabCI, Github Actions, etc.