Jobs › Companies › Avride › Lead AI Infrastructure Engineer

About this Lead AI Infrastructure Engineer role at Avride

Avride · Onsite · Austin, Texas

About the Team

Our team is at the core of Avride's self-driving stack. We build the base infrastructure layer that powers all autopilot code. It includes a C++ framework for implementing autonomy components, execution graph building and optimization systems, as well as runtimes that execute those graphs, both onboard and in simulation.

The vast part of the execution graph is implemented as a chain of neural network operations. The onboard mode relies on stable latencies of the inference of those networks, while in simulation we also optimize throughput at scale.

About the role

We’re looking for a software engineer with a leadership mindset and deep ML infrastructure experience. You will decide and influence the ML infrastructure layer across the company. The biggest challenge we’re facing at the moment is the effectiveness of GPU inference - both for onboard applications with near real-time guarantees and for offboard cases that target high throughput and deterministic execution. It is the first priority within this role.

What you'll do

  • At first, you will take on the GPU inference framework, focusing on performance
  • Later, the role assumes responsibility and ownership for broader ML infrastructure scattered across ML pipelines
  • Close collaboration with the applied ML team responsible for defining the neural model's architecture

What you'll need

  • Experience with PyTorch
  • Understanding of how GPUs work
  • Experience in diagnosing and resolving performance issues
  • Strong record of building infrastructure including distributed systems
  • 5+ years of experience with C++
  • Programming experience in multi-threaded environments - multiple processes, threads, timers, and interrupts

 

#LI-MS1

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation, sponsorship, and remote work options are not available.

Avride is an equal opportunity employer and committed to providing reasonable accommodations to qualified applicants and employees with disabilities to ensure they have equal access to employment opportunities. Avride complies with the Americans with Disabilities Act (ADA), if you need a reasonable accommodation to assist with the application or hiring process, or to perform the essential functions of a job, please email jobs@avride.ai.

Ready to apply to Avride?
Apply to Avride

Similar jobs

Placer.ai
Platform Engineer - AI Tools
Placer.ai
⚡ Apply early Austin, Texas Onsite
● New 👁 Seen ✓ Applied 17h ago
Optiver
Software Engineer - Research Platform
Optiver
⚡ Apply early Austin, Texas, United States Onsite
● New 👁 Seen ✓ Applied 1d ago
Tenstorrent
Infrastructure Operations Engineer / SRE
Tenstorrent
⚡ Apply early Austin, Texas, United States;... Onsite $100,000–$500,000
● New 👁 Seen ✓ Applied 2d ago
Tenstorrent
Infrastructure Automation Engineer, Metal
Tenstorrent
⚡ Apply early Austin, Texas, United States;... Hybrid $100,000–$500,000
● New 👁 Seen ✓ Applied 2d ago
2K
Staff Platform Engineer
2K
⚡ Apply early Austin, Texas, United States Onsite
● New 👁 Seen ✓ Applied 3d ago
PA
Sr Software Engineer, Venmo Platform
PayPal
⚡ Apply early San Jose, California, United S... Hybrid $130,500–$193,600
● New 👁 Seen ✓ Applied 5d ago
Procore
Principal Software Engineer - Infrastructure Platform
Procore
⚡ Apply early US - Texas - Austin Hybrid
● New 👁 Seen ✓ Applied 1w ago
Take-Two Interactive Software, Inc.
Systems Engineer II - Platform & Monitoring
Take-Two Interactive Software, Inc.
⚡ Apply early Austin, Texas, United States Onsite
● New 👁 Seen ✓ Applied 1w ago
Sonarsource
Cloud Platform Engineer
Sonarsource
⚡ Apply early Austin, Texas Onsite
● New 👁 Seen ✓ Applied 1w ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Avride

See all jobs at Avride →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free