Senior Data Engineer

As a Senior Data Engineer in our R&D team, you aren't just moving bytes; you are the architect of the world's most comprehensive food-intelligence engine. You will take full ownership of our ingestion pipelines, transforming massive volumes of unstructured web data into the actionable insights our customers rely on. This role requires a builder who can navigate complex anti-bot measures, design resilient distributed systems, and ensure our data remains flawless as we scale.

Key responsibilities:

Own end-to-end architecture and delivery of our web-scale data ingestion pipelines, from resilient scraping through transformation and storage.
Design and maintain scrapers that reliably bypass anti-bot measures and handle dynamic content at scale, adapting quickly as sources change.
Leverage AI coding assistants (Claude Code, Codex) to accelerate development, optimize pipeline logic, and ship faster within titling R&D cycles.
Build and manage distributed, cloud-based data pipelines that support real-time analytics and AI model deployment.
Proactively identify and resolve data quality issues before they reach production, ensuring accuracy and consistency across all sources.
Architect scalable API and system designs that connect pipeline decisions directly to business value and consumer-trend accuracy.
Monitor, troubleshoot, and continuously improve data workflows to keep the engine reliable as we scale.