Staff Product Engineer, Backend (Go)

Caddie is hiring on behalf of a high growth, venture backed observability company building a next generation telemetry data platform for modern engineering teams.

This company is not building another observability tool. Their mission is to bring observability closer to developers and make it part of everyday workflows. They focus on simplicity, clarity, and deep technical power. Customers value the streamlined experience and strong performance. The company is scaling quickly.

They are looking for a Staff Product Engineer to lead the architectural vision of their backend. You will join the Intelligent Edge team and extend OpenTelemetry Collector capabilities to intelligently reduce and optimize high volumes of telemetry data. The goal is to help customers manage large OpenTelemetry environments with clarity and efficiency.

You will not just write code. You will own the technical roadmap, drive economic efficiency across the data infrastructure, and mentor a team of strong engineers.

Salary Range

$125,000 - $142,000 USD per year

Logistics

• EU | Israel, Remote

• English fluency required

• In person interviews preferred in Germany or manager can travel

• EMEA time zone collaboration required

The Challenge You’ll Tackle

• Architect for massive scale and complexity. You will provide technical leadership for core ingestion and processing pipelines. You will anticipate bottlenecks and ensure systems scale smoothly.
• Telemetry Manipulation. You will process and manipulate telemetry data at scale. You will design aggregation and sampling strategies while eliminating single points of failure.
• Drive reliability and risk management. You will own platform reliability, proactively identify risks, and strengthen a security first culture. You will elevate monitoring and observability practices internally.
• Provide mentorship and improve the process. You will define standards for code quality, testing, and observability. You will mentor engineers, review PRDs for technical feasibility, and align architecture with product goals.

What Success Looks Like and How You’ll Get There

• Within 1 week, you will ship production ready code.
• Within 3 months, you will extend pipeline mechanisms with new aggregation and sampling capabilities deployed in both SaaS and customer environments.
• Within 6 months, you will establish architectural patterns for Go services and OpenTelemetry Collector distributions. You will mentor engineers across the organization and elevate distributed systems knowledge.
• Within 12 months, you will serve as a technical authority for the Intelligent Edge strategy. You will guide the team through major scaling challenges and influence the product roadmap by bridging technical constraints with customer needs.

We’re looking for someone who

• Has deep architectural expertise in building and scaling distributed backend systems using Go. You understand distributed systems trade offs and explain them clearly.
• Has solid knowledge of Kafka and messaging patterns. You design efficient, high throughput data pipelines.
• Expertly leverages AI and agentic coding tools to accelerate development while applying strong technical judgment to validate and refine output.
• Has strong product and economic thinking. You collaborate with product teams to evaluate feasibility and resource efficiency.
• Is a natural mentor and cultural leader. You improve team processes, foster psychological safety, and raise engineering standards.
• Lives and breathes observability. You bring deep expertise in OpenTelemetry and monitoring practices and apply them internally and externally.

Must Haves

• Deep architectural expertise in building and scaling distributed backend systems
• Strong hands-on experience with Go
• Experience designing and scaling high-throughput ingestion and processing pipelines
• Strong understanding of distributed systems trade-offs
• Experience preventing single points of failure
• Experience architecting for massive scale and reliability
• Solid knowledge of Kafka
• Strong understanding of messaging systems and patterns
• Experience processing and manipulating telemetry data at scale
• Experience with aggregation, sampling, or volume management mechanisms
• Deep expertise in OpenTelemetry
• Strong knowledge of monitoring and observability practices
• Experience defining observability standards internally
• Experience owning technical roadmaps
• Strong product thinking and economic efficiency mindset
• Ability to evaluate feasibility and resource trade-offs
• Experience mentoring engineers
• Experience defining engineering standards code quality, testing, reliability
• Experience reviewing PRDs for technical feasibility
• Strong collaboration with product teams
• Experience leveraging AI and agentic coding tools
• Strong technical judgment to validate and refine AI-generated output

Nice to Haves

• Experience extending or working directly on OpenTelemetry Collector distributions
• Experience working on SaaS plus customer deployed hybrid architectures
• Experience driving organization wide architectural patterns
• Experience shaping product roadmap through technical leadership
• Experience fostering psychological safety and improving team processes
• Security first mindset with experience driving security culture
• Experience building economic efficiency models for infrastructure cost optimization