עדיין מחפשים עבודה במנועי חיפוש? הגיע הזמן להשתדרג!
במקום לעבור לבד על אלפי מודעות, Jobify מנתחת את קורות החיים שלך ומציגה לך רק משרות שבאמת מתאימות לך.
מעל 85,000 משרות • אלפי משרות חדשות בכל יום
חינם. בלי פרסומות. בלי אותיות קטנות.
DOCX, DOC, PDF - בעברית או באנגלית
כבר העליתם קו"ח בעבר? כניסה
About Spieron
Spieron is a technology services company specializing in Data, Big Data and advanced data infrastructure, and an official Cloudera partner. Our engineers work on-site at our customers, embedded in their teams, backed by Spieron's senior team.
About the role
You will work on-site at our customers, inside their data team, building and running the batch and streaming pipelines that move data from their source systems into the lakehouse. You own those pipelines end-to-end: from the first conversation about a new source, to the day the customer's operations team takes them over.
Day to day
- Take a new source system (database, files, message queue, API) and get its data into the lakehouse end-to-end: ingestion, validation, cleansing, enrichment and loading into Iceberg tables people can trust.
- Build and maintain streaming flows (NiFi, Kafka, Flink / SQL Stream Builder) and batch jobs (Spark), and decide which one each use case needs.
- Make sure nothing gets lost silently: bad records are rejected with a reason, can be inspected and replayed, and late or duplicate data is handled correctly.
- Start the morning by checking what failed or ran late overnight. Find the root cause in logs, the Spark UI or the NiFi bulletins, fix it, and make sure it doesn't happen again.
- Tune slow or expensive jobs (partitioning, file sizes, joins, resources) and keep Iceberg tables healthy (schema and partition evolution, compaction, snapshot expiry, rollback when needed).
- Work directly with the customer's analysts, DBAs and platform admins. Clarify requirements, explain trade-offs, and push back when something won't hold up in production.
- Handle tickets and escalations for the pipelines you own, including opening and driving cases with vendor support.
- Write runbooks and hand-over docs, and train the customer's team so they can run what you built.
Requirements
- Hands-on experience developing Apache Spark applications (PySpark or Scala).
- Experience building ingestion and streaming pipelines with Apache Kafka and a flow / streaming tool (Apache NiFi, Apache Flink or similar).
- Working knowledge of Apache Iceberg tables and an Iceberg catalog.
- Strong SQL and Python.
- SQL query engines: Trino and / or Impala.
- Comfortable working in Linux: shell, logs, processes, permissions, networking basics.
- Familiarity with Kubernetes and containers.
- Comfortable working on-site with customers, with clear written and spoken communication.
Advantages
None of these are required; each one is a plus.
Cloudera background
- Hands-on Cloudera (CDP): CDF / NiFi, Streams Messaging, CDE, CDW
- Cloudera Data Engineer certification
- Cloudera Data Lakehouse Engineer certification
- Cloudera Data Operator certification
- Apache Ozone
Linux / DevOps / GitOps
- Linux administration
- Git and CI/CD (GitLab CI / GitHub Actions / Jenkins)
- GitOps (Argo CD / Flux), Docker, Helm
- Infrastructure as code (Ansible / Terraform)
Also great
- Orchestration (Airflow or similar), dbt
- CDC (Debezium, GoldenGate or similar)
- Relational databases (PostgreSQL / Oracle / SQL Server)
- Observability (Prometheus / Grafana / ELK)
- Cloud data services (AWS / Azure / GCP)
- Consulting, professional services or support experience
How to apply
Apply here on LinkedIn, or send your CV to [email protected] with the subject "Application: Data Engineer".
במקום לעבור לבד על אלפי מודעות, Jobify מנתחת את קורות החיים שלך ומציגה לך רק משרות שבאמת מתאימות לך.
מעל 85,000 משרות • אלפי משרות חדשות בכל יום
חינם. בלי פרסומות. בלי אותיות קטנות.
DOCX, DOC, PDF - בעברית או באנגלית
כבר העליתם קו"ח בעבר? כניסה
הרצליה
ערב