Senior Data Engineer

Passionate about food and curious about what drives consumer choices? Join Tastewise and help shape the future of the food and beverage industry.

Tastewise is a human-and-agent food intelligence and marketing platform used by leading companies like PepsiCo, Nestlé, and Kraft Heinz to decide what products to launch, how to market them, and what ultimately makes it to the shelf.

We turn real consumer behavior into actionable insights, helping teams make smarter, faster decisions in a $10 trillion industry that impacts billions of people every day.

If you’re excited about turning data into real-world impact and being part of a collaborative team with a clear mission, this is the place for you!

About the role:

As a Senior Data Engineer in our R&D team, you aren't just moving bytes; you are the architect of the world's most comprehensive food-intelligence engine. You will take full ownership of our ingestion pipelines, transforming massive volumes of unstructured web data into the actionable insights our customers rely on. This role requires a builder who can navigate complex anti-bot measures, design resilient distributed systems, and ensure our data remains flawless as we scale.

Key responsibilities:

• Own end-to-end architecture and delivery of our web-scale data ingestion pipelines, from resilient scraping through transformation and storage.
• Design and maintain scrapers that reliably bypass anti-bot measures and handle dynamic content at scale, adapting quickly as sources change.
• Leverage AI coding assistants (Claude Code, Codex) to accelerate development, optimize pipeline logic, and ship faster within titling R&D cycles.
• Build and manage distributed, cloud-based data pipelines that support real-time analytics and AI model deployment.
• Proactively identify and resolve data quality issues before they reach production, ensuring accuracy and consistency across all sources.
• Architect scalable API and system designs that connect pipeline decisions directly to business value and consumer-trend accuracy.
• Monitor, troubleshoot, and continuously improve data workflows to keep the engine reliable as we scale.
  
  

• 5+ years of experience in Data Engineering or Backend roles focused on high-volume data processing.
• Experience with Airflow & Databricks
• Expert-level web scraping skills: proven ability to build resilient scrapers that bypass anti-bot measures and handle dynamic content at scale.
• Extreme ownership: a track record of managing pipelines end-to-end and proactively fixing quality issues before they reach production.
• High AI-literacy: active use of LLMs and AI coding assistants (Claude Code, Codex) to accelerate development and optimize logic.
• Strong technical depth in distributed systems, cloud architecture, and low-latency data modeling.
• Data literacy: the ability to connect technical pipeline decisions to business value and consumer trend accuracy..
• Experience with System Design Thinking and building scalable API architectures.