About the role

The Senior DevOps Engineer will be responsible for enhancing and scaling the infrastructure powering Rhino’s Federated Computing Platform (Rhino FCP). This distributed infrastructure supports cutting-edge AI/ML research and development across highly regulated industries, including healthcare, finance, and life sciences, by enabling secure, privacy-preserving data collaboration around the world.

You will oversee a fleet of installations deployed behind the firewalls of partner organizations, alongside a centralized cloud orchestration layer and advanced CI/CD pipelines, monitoring systems, and deployment tooling. You'll collaborate closely with backend engineers, as many infrastructure components are tightly integrated with the FCP’s core capabilities.

This role involves end-to-end ownership: from architecture and design to implementation and support. It’s ideal for someone who thrives in fast-paced environments, loves working with modern infrastructure, and is excited to drive innovation in secure, distributed AI platforms.

Key Responsibilities

• End-to-End Infrastructure Ownership: Take full ownership of infrastructure components - from initial ideation and architectural design through implementation and automated deployment, across diverse technologies and geographically distributed environments.
• Scalability and Enhancement: Continuously enhance and scale the platform’s underlying infrastructure by implementing updates, driving performance improvements, and integrating new platform capabilities to support product growth.
• Maximize Development Velocity: Design, improve, and maintain DevOps tooling and workflows (CI/CD pipelines, configuration management) to significantly boost development velocity and streamline the engineering process.
• Distributed Deployment Management: Oversee and manage all platform deployments, ensuring consistency and reliability across local installations at client sites and within the centralized cloud orchestration layer.
• Product Development: Collaborate closely with Backend and Frontend Engineering teams to co-develop platform features that have significant infrastructure dependencies, ensuring new capabilities are designed and implemented with built-in scalability and operational tooling.
• Establish Foundational Quality: Ensure observability, scalability, and security are deeply integrated and prioritized across the design, implementation, and operation of all infrastructure layers.

About the candidate

Candidates should have 5+ years of professional experience with a mix of the experiences described below:

• 5+ years of experience in DevOps engineering with clouds, GCP/AWS preferred
• 5+ years of experience designing and developing infrastructure components with Kubernetes (Including solid understanding of CRD on different Kubernetes platforms)
• Extensive experience with Linux, Docker/ContainerD
• 5+ years of experience with Python
• 5+ years of experience working with IaC and CM tools (Terraform, Terragrunt, Ansible)
• 5+ years of experience implementing monitoring solutions (Prometheus/VictoriaMetrics, Grafana, GoAlert, etc) and logging systems (VictoriaLogs or similar, Filebeat/FluentBit/Vector, etc.)
• 3+ years of experience with CI/CD tools like GitHub Actions
• 3+ years of experience with GitOps tools (ArgoCD)
• Deep understanding of networking and experience developing infrastructure with non-trivial networking components (e.g. WireGuard VPN, NGINX passthrough, mTLS, gRPC, confidential computing environments, etc)
• Experience working in a startup environment
• Advantage for experience developing AI/ML-based products or platforms
• Advantage for experience developing distributed systems
• Advantage for experience developing products with a focus on data security and privacy (e.g., PII data protection)
• The role is open to candidates who are based in Israel (hybrid work environment)

About Rhino Federated Computing

Rhino Federated Computing Rhino solves one of the biggest challenges in AI: seamlessly connecting siloed data through federated computing. Our platform leverages federated computing to connect disparate data sources, enabling secure global collaboration for data pre-processing, AI model training and deployment, without compromising privacy, intellectual property, or data security. Our platform allows for the secure deployment of custom code and third party applications via persistent data pipelines. To do this, Rhino FCP offers flexible architecture across multi-cloud and on-prem hardware, end-to-end data management workflows (multimodal data, schema definition, harmonization, and visualization), and privacy enhancing technologies (e.g., differential privacy). Rhino is trusted by over 60 leading organizations worldwide - including 14 of 20 of Newsweek’s ‘Best Smart Hospitals’ and Top 20 global biopharma companies. Our vertical-agnostic infrastructure is also a foundation for financial services, eCommerce, and beyond.

The company is headquartered in Boston, with an R&D center in Tel Aviv.

About the Role

We are seeking a highly motivated, detail-oriented, technology-savvy, and creative Senior Product Manager to join our team in the United States. Reporting directly to the VP Product, you will be instrumental in shaping the future of the Rhino Federated Computing Platform.

In this critical role, you will work closely with our Engineering and UX teams to elevate the end-to-end platform experience, spanning the Graphical User Interface (GUI), Software Development Kits (SDKs), and external APIs.  You will be instrumental in defining and delivering the product roadmap with a strong emphasis on platform interoperability and extensibility, assisting quarterly planning cycles, and defining innovative new product features that address the complex needs of our enterprise customers in healthcare, life sciences, and financial services. You will own the user journey from initial data federation to the deployment of production-ready AI agents.

This is a unique opportunity to make a significant impact in a fast-paced, successful startup environment, directly contributing to a platform that is breaking down data barriers and accelerating AI innovation in critical industries.

Key Responsibilities

• Collaborate closely with the VP Product on overall product strategy, roadmap prioritization, and market analysis.
• Define detailed product requirements, user stories, and acceptance criteria for both technical (API/SDK) and end-user (GUI) use cases, ensuring a cohesive experience across all platform surfaces.
• Define requirements for deep-seated AI agents and manage integrations with cloud AI/ML services and compatible with the Model Context Protocol (MCP) to deepen platform analytical capabilities and streamline end-to-end federated workflows.
• Manage and prioritize the product backlog, ensuring alignment with the product roadmap and business objectives. Conduct market research, competitive analysis, and gather customer feedback to identify opportunities and inform product decisions.
• Effectively lead and facilitate agile ceremonies, including sprint pre-planning, sprint planning, daily stand-ups, and sprint retrospectives, to optimize team collaboration and efficiency.
• Collaborate with client-facing teams, providing product materials and expertise. Translate field insights and customer needs into impactful platform improvements and new features, acting as the customer and end-user advocate to Engineering.
• Champion the user experience and UX design, working closely with design resources to create powerful interfaces and seamless developer experiences that simplify the management of the AI lifecycle.
• Define and track key product metrics, analyze performance data, and leverage insights to inform product iterations and strategic decisions.

Required Qualifications

• 4+ years of product management experience in B2B SaaS building AI/ML/Data platforms, with a total of 8+ years of experience in these fields.
• Proven ability to own product areas, define roadmaps, and drive product development from conception to launch within an agile environment.
• Strong understanding of deep tech AI/ML product development with the ability to engage in technical discussions with data scientists.
• Proven experience with user experience (UX) principles and collaborating with UX designers.
• Excellent written and verbal communication skills and exceptional attention to detail.
• Experience working in a startup or fast-growing technology company.
• Based in Boston, MA, USA (hybrid work environment).

Preferred Qualifications

• Applied experience working with Agentic AI workflows, platform integrations, and/or MLOps products.
• A proven track record of delivering highly usable and intuitive enterprise platform experiences (GUI, SDKs, APIs) that simplify complex technical workflows, demonstrating a balance of user-centered design and technical performance.

About the role

The Senior Backend Engineer will be responsible for enhancing and scaling Rhino’s Federated Computing Platform (FCP), used around the world to power cutting edge AI/ML research and development for healthcare and other regulated industries, ultimately driving a shift in innovation and delivery in these industries. You will be responsible for developing new features and enhancements spanning several different technologies and will be expected to learn new technologies as this field is evolving rapidly. You will work closely with other backend engineers, frontend engineers, devops engineers, data scientists, product managers, and business stakeholders across the company. Day-to-day, your role will be architecting, designing, and developing backend sub-systems in Python. You will also work closely with frontend development in JavaScript/TypeScript and React, with infrastructure development on Kubernetes with Terraform, and with data science and AI/ML development using a wide range of model architectures and libraries. This role is for a fast learner who loves technology and is excited to build a cutting edge platform that will improve healthcare and privacy preservation around the world.

• Take entire backend sub-systems from ideation through design and implementation across a broad range of technologies and environments.
• Interface closely with (occasionally also writing code for) frontend, devops, and data science components.
• Introduce improvements to our tools and methodologies to increase the velocity of our development team and the reliability of our platform, including using the latest AI tooling.

About the candidate

Candidates should have the experience described below:

• 7+ years of software development
• 5+ years developing production platforms/products/applications in Python
• 3+ years using web application frameworks like Django/Flask/FastAPI
• Experience working in a startup environment
• Advantage for experience developing AI/ML based products or platforms
• Advantage for experience developing distributed systems
• The role is open to candidates who are based in Israel (hybrid work environment)