Data Engineer – Data Observability & Pipelines

Department
R&D
Type
Full-time
Level
Location
Israel
About The Position

Fetcherr experts in deep learning, e-commerce, and digitization, Fetcherr disrupts traditional systems with its cutting-edge AI technology. At its core is the Large Market Model (LMM), an adaptable AI engine that forecasts demand and market trends with precision, empowering real-time decision-making. Specializing initially in the airline industry, Fetcherr aims to revolutionize industries with dynamic AI-driven solutions.

We are looking for a highly experienced and hands-on Data Engineer to lead the development of our internal data observability and orchestration ecosystem. This role combines strong technical execution with cross-organizational collaboration, playing a critical role in ensuring the reliability, traceability, and visibility of our data pipelines and assets.

You’ll design and own systems that detect issues before they impact production, visualize key data quality metrics, and provide internal stakeholders with intuitive access to data lineage, validation errors, and pipeline performance.

Responsibilities:

Pipeline Orchestration & Monitoring

Design, build, and maintain scalable Dagster data pipelines.
Integrate data validation checkpoints into a dedicated pipeline and connect alerts to Google Cloud Monitoring and incident.io
Track and visualize data arrival status, pipeline execution results, and anomalies.

Data Observability & UI

Build and maintain an internal UI dashboard to display:
Data validation errors
Pipeline execution status
Time series trends (e.g., volume anomalies)
Dataset arrival status
Various prometheus KPIs
Create visual and interactive tools to support investigation and resolution of data issues.

Data Management & Collaboration

Implement data lineage, data cataloging, and metadata management across datasets.
Enable controlled editability and auditability of BigQuery tables through intuitive tools.
Collaborate across R&D, Product, and Data Science teams to align on standards and practices.
About The Position

You'll be a great fit if you have...

5+ years experience as a Data Engineer or similar role.
Expert-level Python skills and hands-on experience with Dagster (or similar orchestration frameworks).
Strong knowledge of SQL, preferably with BigQuery.
Experience building internal tools or UIs for data observability and management.
Deep understanding of data reliability, validation, and schema management.
Strong system design skills and experience implementing cross-team infrastructure.
Excellent communication skills and ability to operate cross-functionally.
Self-motivated and proactive learner, comfortable with ownership and ambiguity.
Experience as a team leader or technical lead – a strong advantage.

Nice to Have ...

Proven experience integrating systems with Google Cloud Monitoring
Experience with data catalogs.
Familiarity with CI/CD practices for data pipelines.
Background in high-scale or real-time data systems.