Jobs Companies NVIDIA Distinguished Engineer - Rack Scale Architecture

About this Distinguished Engineer - Rack Scale Architecture role at NVIDIA

NVIDIA · Onsite · US, CA, Santa Clara

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

NVIDIA has a rapidly expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each bringing together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly motivated, technical leader to drive the engineering roadmap and innovation for our rack system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.

What you’ll be doing:

  • Drive the software end-to-end architecture for NVIDIA's rack-scale products

  • Maintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.

  • Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.

  • Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.

  • Work with business partners and vendors to shape their products to meet NVIDIA’s needs.

  • Develop a roadmap of new technologies and protocols; drive their design and adoption.

  • Mentor architects and engineering teams to grow them into future leaders.

  • Make key technical decisions even when faced with ambiguity

What we need to see:

  • BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.

  • 15+ years in the area of System architecture and design

  • Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.

  • Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband)

  • Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs

  • Expertise in out-of-band and in-band management architectures.

  • Knowledge of system management protocols such as Redfish and IPMI.

  • Experience working with platform security experts to define tradeoffs between security and ease of use.

  • Demonstrable experience in implementing left shift strategy to de-risk program execution. Excellent written and verbal communication skills.

Ways to stand out from the crowd:

  • Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabrics

  • Demonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment.

  • Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies.

We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. So if you're clever, creative, and driven, we'd love to have you join the team.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 26, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Ready to apply to NVIDIA?
Apply to NVIDIA

About NVIDIA

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA .

See all jobs at NVIDIA →

Similar jobs

NVIDIA
Distinguished Engineer, Production Engineering, Cluster Management
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 3d ago
NVIDIA
Principal Software Engineer - Rack Scale Systems Infrastructure
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 1w ago
NVIDIA
Principal Software Engineer, Vehicle Dynamics Simulation - AV
NVIDIA
⚡ Apply early US, CA, Santa Clara Onsite
● New 👁 Seen ✓ Applied 1w ago
Anduril Industries
Principal Radar Engineer, Space
Anduril Industries
⚡ Apply early Costa Mesa, California, United... Onsite $220,000–$293,000
● New 👁 Seen ✓ Applied 12h ago
Anduril Industries
Principal Test & Evaluation Engineer - Networked Battlefield Systems
Anduril Industries
⚡ Apply early Costa Mesa, California, United... Onsite $220,000–$292,000
● New 👁 Seen ✓ Applied 13h ago
Anduril Industries
Principal Digital Hardware Engineer (PCBs/FPGAs/HDL)
Anduril Industries
⚡ Apply early Costa Mesa, California, United... Onsite $220,000–$292,000
● New 👁 Seen ✓ Applied 14h ago
ASM
Principal Field Process Engineer
ASM
⚡ Apply early US > Oregon > Hillsboro Onsite
● New 👁 Seen ✓ Applied 14h ago
Olsson
Principal Engineer - Site Design
Olsson
⚡ Apply early Dallas, TX; Fort Worth, TX; Ok... · location restricted
● New 👁 Seen ✓ Applied 20h ago
Relativity Space
Principal Turbomachinery Test Responsible Engineer
Relativity Space
⚡ Apply early Long Beach, California Onsite $185,000–$277,000
● New 👁 Seen ✓ Applied 21h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at NVIDIA

See all jobs at NVIDIA →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free