Senior Product Manager

About Rhino

Rhino Federated Computing Rhino solves one of the biggest challenges in AI: seamlessly connecting siloed data, apps, and models through federated computing. Our platform enables our customers to share business insight and processing without compromising intellectual property, data privacy, or data security. Our Rhino Federated Computing Platform offers flexible architecture across multi-cloud and on-prem hardware, end-to-end data management controls and workflows, and privacy enhancing technologies. Rhino is trusted by over 60 leading consortia and enterprises worldwide, including 14 of 20 of Newsweek’s ‘Best Smart Hospitals’ and top 20 global biopharma companies.

The company is headquartered in Boston, with an R&D center in Tel Aviv.

About The Role

We are seeking a highly motivated, detail-oriented, technology-savvy, and creative Senior Product Manager to join our team in Israel. Reporting directly to the VP of Product, you will be instrumental in shaping the future of the Rhino Federated Computing Platform.

In this critical role, you will own the end-to-end journey for the "Day 0" experience including deployment, installation, orchestration, scaling, and management of edge computing to accelerate time to customer value and support any computational needs at the edge. You will collaborate closely with Engineering to deliver a platform with a strong emphasis on infrastructure reliability, deployment flexibility, scalability, and edge compute capabilities. You will be instrumental in defining and delivering the product roadmap, assisting quarterly planning cycles, and defining innovative new product features that address the complex needs of our enterprise customers in healthcare, life sciences, and financial services.

This is a unique opportunity to make a significant impact in a fast-paced, successful startup environment, directly contributing to a platform that is breaking down data barriers and accelerating AI innovation in critical industries.

Key Responsibilities

• Collaborate closely with the VP Product on overall product strategy, roadmap prioritization, and market analysis, with a focus on infrastructure reliability, deployment flexibility, and edge compute capabilities.
• Own the roadmap for platform deployment and runtime infrastructure, including containerized on-premises deployments, multi-cloud orchestration (AWS, GCP, Azure), and lightweight edge node runtimes designed for bandwidth-constrained or air-gapped environments.
• Define detailed product requirements, user stories, and acceptance criteria for infrastructure-layer features: node provisioning and lifecycle management, secure tunnel connectivity, resource scheduling, and cross-site orchestration.
• Manage and prioritize the product backlog, ensuring alignment with the product roadmap and business objectives. Conduct market research, competitive analysis, and gather customer feedback to identify opportunities and inform product decisions.
• Effectively lead and facilitate agile ceremonies, including sprint pre-planning, sprint planning, daily stand-ups, and sprint retrospectives, to optimize team collaboration and efficiency.
• Collaborate with Field Teams, providing product materials and expertise. Translate field insights and customer IT constraints into platform infrastructure improvements, acting as the customer and end-user advocate to Engineering.
• Champion observability and operational experience: define requirements for platform monitoring, alerting, audit logging, and self-healing capabilities that allow enterprise customers to operate Rhino FCP nodes with confidence.
• Define and track key infrastructure product metrics — deployment success rates, node uptime, provisioning time, upgrade rollout coverage — and leverage insights to inform product iterations and strategic decisions.
  
  

• 4+ years of product management experience in B2B SaaS building AI/ML/Data platforms, with a total of 8+ years of experience in these fields.
• Proven ability to own product areas for infrastructure or platform products — including on-premises software, distributed systems, container orchestration (Kubernetes, Docker), or edge computing runtimes.
• Strong understanding of deep tech AI/ML product development with the ability to engage in technical discussions with data scientists.
• Proven experience with user experience (UX) principles and collaborating with UX designers.
• Excellent written and verbal communication skills and exceptional attention to detail.
• Experience working in a startup or fast-growing technology company.
• Based in Tel Aviv, IL.
  
  

• Experience with federated systems, distributed compute, or privacy-preserving infrastructure (e.g., federated learning frameworks, trusted execution environments, differential privacy tooling).
• Familiarity with MLOps infrastructure and how model training and inference workloads are scheduled and executed in constrained or distributed environments.