Jobs Companies NVIDIA Principal Product Manager, AI Frameworks

About this Principal Product Manager, AI Frameworks role at NVIDIA

NVIDIA · Onsite · US, CA, Santa Clara

 At NVIDIA, we meet customers where they are on their AI journey on our GPUs - this means we build best in class frameworks in OSS and support a robust ecosystem of other OSS frameworks. NVIDIA's PyTorch Compilers team builds and upstreams to the stack that sits between PyTorch and NVIDIA hardware — spanning torch.compile, emerging compiler substrates, and the agent-native optimization infrastructure being built for the next era of accelerated computing. This role will build and direct product strategy across the full arc. It involves shipping the latest hardware features in torch.compile today. It also includes developing the canonical shared representation across NVIDIA's compiler and runtime ecosystem. Additionally, it focuses on crafting how agents will engage in deep learning performance work in the future. 

We are looking for someone who understands compilers and can operate at the intersection of systems architecture, framework engineering, and customer-facing product strategy working directly with engineering leadership and NVIDIA's most sophisticated external customers — including frontier model labs, inference/training and RL framework teams such as vLLM, SGLang, torchtitan, megatron-core, and hardware co-design programs. As NVIDIA Product Managers, we partner with NVIDIA leaders to define clear product strategy, and marketing team teams to build go-to-market plans. The Product Management organization at NVIDIA is a flexible, strong, and impactful group focusing on enabling deep learning across all GPU use cases and providing great products for our users. We seek an individual with a rare blend of product skills, technical depth, and passion to join our team. Does that sounds familiar? If so, we would love to hear from you!

What you'll be doing:

Own the strategy for NVIDIA's PyTorch compiler portfolio, including:

  • torch.compile — maintain and evolve NVIDIA's upstream PyTorch path, drive HW support, resolve customer issues across dynamic shapes, kernel performance, and compile overhead

  • define the roadmap and go-to-market for NVIDIA's shared representation layer across frameworks, compilers, kernel libraries, and runtimes

  • Agent-native compiler workflows — shape the product vision for how agentic systems will participate in optimization tasks

  • Inter-kernel optimization features — build product requirements for capabilities like megakernels and ensure they ship with demonstrated real-world value

Lead product strategy across the roadmap:

  • Define Now/Next/Later priorities in close partnership with engineering leads

  • Translate ecosystem signals (vLLM RFCs, SGLang CUDA Graph patterns, TorchTitan GraphTrainer plans, Meta's upstream priorities) into prioritized product decisions

Engage directly with customers and partners:

  • Represent NVIDIA at PyTorch contributor and ecosystem forums;

Define success metrics and release criteria:

  • Establish performance gates and adoption milestones

  • Set bar for what "proven" means for new optimizations before committing to roadmap

What we need to see:

  • 15+ years in technical product management, with 5 years owning a compiler, runtime, or low-level systems product at scale

  • BS or MS degree in Computer Science, Electrical Engineering, a related technical field, or equivalent experience.

  • Experience with OSS-first products and upstream contribution strategy

  • Track record of shipping and driving adoption for developer efficiency and performance oriented infrastructure products

  • Understands how inference frameworks use compiler technology — where they adopt torch.compile, where they go around it, and why

  • Understands how new hardware features create new compiler requirements

  • Can write clear, defensible strategy documents and knows how to scope an early-access release:

  • Strong instinct for where to concentrate investment vs. spread it

Ways to stand out from the crowd:

  • Deep understanding of the PyTorch compiler stack and how to influence strategy in this ecosystem

  • You've worked on how agents participate in systems-level optimization workflows

  • Familiarity with MLIR-based compiler infrastructure and how it maps to NVIDIA hardware primitives

  • Can reason about inter-kernel optimization tradeoffs to define the right bar for "proven"

  • Comfortable reading kernel performance profiles and debug how torch.compile can help any model

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 240,000 USD - 379,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 27, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Ready to apply to NVIDIA?
Apply to NVIDIA

About NVIDIA

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA .

See all jobs at NVIDIA →

Similar jobs

NVIDIA
Principal Product Manager - Laptop GPU and SoC
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 2d ago
Picarro, Inc
Software Engineering Manager - Cloud Software, Data Platform & AI-Agentic Product Engineering
Picarro, Inc
⚡ Apply early Santa Clara, CA Onsite $200,000–$215,000
● New 👁 Seen ✓ Applied 3d ago
Picarro, Inc
Product Manager, Natural Gas
Picarro, Inc
⚡ Apply early Santa Clara, CA Onsite $125,000–$140,000
● New 👁 Seen ✓ Applied 3d ago
NVIDIA
Product Manager, AI for Quantum
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 3d ago
NVIDIA
Product Marketing Manager, Quantum Computing Platform
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 4d ago
Portless
Senior Product Manager
Portless
⚡ Apply early Shenzhen, Guangdong Province,... Onsite
● New 👁 Seen ✓ Applied 4h ago
Stitch Fix
Lead Engineer - Product Catalog Team
Stitch Fix
⚡ Apply early Remote, USA · location restricted $125,000–$186,000
● New 👁 Seen ✓ Applied 5h ago
NL
Tech Lead, Product & Inforce App Development
National Life Insurance Company
⚡ Apply early Addison, TX; Montpelier, VT Onsite $106,875–$156,750
● New 👁 Seen ✓ Applied 7h ago
Roku
Senior Product Manager, Content Conversion
Roku
⚡ Apply early San Jose, California Onsite $260,000–$330,000
● New 👁 Seen ✓ Applied 7h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at NVIDIA

See all jobs at NVIDIA →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free