Jobs › Companies › NVIDIA › Technical Product Manager - AI Infra Resilience

Über diese Technical Product Manager - AI Infra Resilience Stelle bei NVIDIA

NVIDIA · Vor Ort · US, CA, Santa Clara

GPU clusters fail. Workloads crash at 3am, AI teams file tickets pointing at hardware, hardware teams point back at software, and the actual cause stays unknown until someone with deep enough context digs through DCGM metrics, XID history, and NCCL traces. That forensics work shouldn't fall to a human on-call every time. We're building the platform that automates it, and we need a PM who has been that on-call engineer.


We're hiring a Senior Product Manager to own workload failure attribution: how a GPU cluster figures out whether a failed job was caused by hardware, system software, or application code, and how that verdict gets surfaced to operators, schedulers, and the open source developer surface built on top of it. You will own the roadmap and work directly with the engineering and operations communities who deploy and extend this platform. This role is part of NVIDIA's DSX Platform, NVIDIA's open, modular infrastructure software for designing, operating, and optimizing AI factories at scale. No prior product management title required. If you are a deeply technical product manager, architect, SRE, or infra engineer who has lived the GPU cluster failure-triage problem, we want to hear from you.


What You'll Be Doing:

  • Drive the product vision, roadmap, and delivery for workload failure attribution, in close collaboration with engineering on architecture and prioritization.
  • Identify gaps in how customers and partners triage GPU cluster failures at scale and define new attribution capabilities to close them, including how an NCCL timeout gets attributed to hardware, system software, or application, and which signals belong in a public API vs. an entitled runtime extension.
  • Work directly with cloud partners and cluster operators to translate their operational triage requirements into platform capabilities.
  • Drive community engagement strategy for the open source attribution project, including contribution models, ecosystem partnerships, and developer adoption.

What We Need To See:

  • 12+ years total experience.
  • 5+ years in product management, solutions architecture, software engineering, or site reliability engineering on technical infrastructure products. Technical depth on GPU or AI infra is required.
  • Familiarity with GPU failure modes: XID codes, ECC correctable and uncorrectable errors, DCGM metrics, NVLink and PCIe health signals.
  • Technical understanding of why AI workloads fail: GPU hardware failure modes, distributed training failure patterns (NCCL timeouts, framework errors, hardware vs. system software vs. application fault distinction), and the telemetry systems (DCGM, sysfs, dmesg) that surface these signals.
  • Demonstrated ability to work with senior technical customers and translate operational requirements into product decisions.
  • Strong written and verbal communication across technical and non-technical audiences.
  • Bachelor's degree in Computer Science or equivalent experience.

Ways To Stand Out From The Crowd:

  • Former SRE or infra engineer on GPU clusters. You have triaged job failures, parsed XID logs, and understand the cross-team deep dives that happen when a multi-thousand-GPU training run fails.
  • Deep familiarity with GPU scheduling, topology-aware placement, or multi-tenant GPU cluster management: Slurm prolog/epilog, Kueue, or Kubernetes-native scheduler environments.
  • Experience building products that produce structured diagnostics or attribution output: health verdict schemas, log analysis pipelines, rules-engine systems, or observability APIs at data center scale.
  • Practical experience delivering or contributing to an open-source infrastructure project, including managing contributor engagement on GitHub.

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the world's most forward-thinking and hardworking people on our team. If you're creative and autonomous, we want to hear from you!


#LI-Hybrid

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
195,000 USD – 377,000 USD for Level 5; and 232,500 USD – 442,000 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 24, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Bereit, sich bei NVIDIA zu bewerben?
Bei NVIDIA bewerben

Über NVIDIA

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA .

Alle Jobs bei NVIDIA ansehen →

Ähnliche Jobs

NVIDIA
Senior Technical Program Manager, AI Labs
NVIDIA
⚡ Früh bewerben US, CA, Santa Clara Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
NVIDIA
Senior Integrated Technical Customer Program Manager
NVIDIA
⚡ Früh bewerben US, CA, Santa Clara Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
NVIDIA
Senior Software Technical Program Manager, CUDA Robotics
NVIDIA
⚡ Früh bewerben US, CA, Santa Clara Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 3 Tg.
Marvell
Senior Staff Technical Development Program Manager
Marvell
⚡ Früh bewerben US-CA - Santa Clara Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
Motive
Manager, Technical Program Management
Motive
⚡ Früh bewerben Hybrid - San Francisco, Califo... Hybrid $200,000–$270,000
● Neu 👁 Gesehen ✓ Beworben vor 4 Std.
Redwood Materials
Senior Technical Program Manager, Production Engineering
Redwood Materials
⚡ Früh bewerben McCarran, NV Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 4 Std.
TraceLink, Inc
Technical Product Manager (Platform)
TraceLink, Inc
⚡ Früh bewerben APAC - India - Pune Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 5 Std.
Salient
Technical Program Manager, Taylor
Salient
⚡ Früh bewerben SF Headquarters Vor Ort $160,000–$200,000
● Neu 👁 Gesehen ✓ Beworben vor 7 Std.
Delinea
Technical Program Manager Data
Delinea
⚡ Früh bewerben Mexico City Hybrid MXN 900,000–MXN 960,000
● Neu 👁 Gesehen ✓ Beworben vor 7 Std.

Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

Mehr Jobs bei NVIDIA

Alle Jobs bei NVIDIA ansehen →

Jetzt bewerben
🤖

Moment — langsam

JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Verschaffe dir einen Vorsprung bei der Jobsuche.

Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

Dem Kanal beitreten — kostenlos