Data Engineer

Company Overview:

Join our innovative startup at the forefront of leveraging biological expertise and data science to break visibility barriers in food crops’ supply chains.

We are seeking a talented Data engineer to maintain and expand our internal and external data flows. If you're passionate about making an impact and taking part in the full product lifecycle, we want you on our team.

Role Overview:

As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our analytics, machine learning, and business intelligence processes. This is an impactful position connecting the messy inbound, diverse processing and clean insight delivery characteristic of our day-to-day.

Key Responsibilities:

• Design, develop, and optimize ETL pipelines for structured and unstructured data.
• Integrate data from multiple internal and external systems systems and APIs into accessible stores.
• Manage and maintain data storage systems (e.g., SQL, NoSQL, data lakes).
• Monitor, validate, and ensure data quality and consistency across pipelines.
• Work closely with data scientists, analysts, and SW teams to understand data requirements.
• Help facilitate seamless flow between labs, customers, Data and Software.

Qualifications & Requirements

• 5+ years of experience in a data engineering or related role of which 3+ years of Python development
• Expertise in relational and non-relational databases (PostgreSQL, MongoDB, Redis).
• Experience with workflow orchestration (Airflow), data frameworks (Kafka, Flink).
• Familiarity AWS and its data services.
• Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
• B.Sc or higher in CS, Engineering or other technical field preffered.

Bonus points:

• Some familiarity with data science or analytics – courses, curiosity or experience
• A touch of DevOps\MLOps – deploying and maintaining cloud machines and services, CI\CD faimilarity, model monitoring and maintenance.