Jobs › Companies › Prior Labs › Infrastructure Engineer, GPU Clusters

About this Infrastructure Engineer, GPU Clusters role at Prior Labs

Prior Labs · Onsite · Berlin

Who we are

Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables.

We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level.

We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun.

In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years.

About the Role

We spend tens of millions per year on GPU compute to train tabular foundation models. That's not a target, it's what we're running today, and it's growing. The person who owns this infrastructure makes decisions worth millions of dollars: cluster architecture, scheduling efficiency, provider strategy, hardware selection.

Today we run on Slurm across multiple clusters. We're scaling to multi-cluster, multi-provider infrastructure using SkyPilot and evaluating new hardware generations as they come online. You own the full stack, from cluster orchestration and cost optimization to CI/CD, automation, and the tooling that keeps researchers moving fast. You work directly with the research team and understand what they're doing well enough to make infrastructure decisions that actually help them.

What you'll work on:

  • Own and evolve multi-cluster GPU infrastructure, from Slurm and SkyPilot on GCP today to multi-provider orchestration and new GPU generations tomorrow. Drive architecture, automated provisioning, workload scheduling, reliability, cost optimization, and capacity planning against growing compute demands

  • Build the developer productivity layer: CI/CD pipelines, automated testing, reproducible environments, experiment tracking, and internal tooling that keeps research iteration speed high

  • Improve infrastructure reliability through monitoring, observability, infrastructure as code, and automation. Reduce operational toil and make complex systems easier to manage.

  • Help guide compute spending decisions. You understand cost per FLOP across providers and hardware, and you hate wasted compute

Tech stack: Slurm, SkyPilot, GCP (+ AWS and Azure to come), Docker, Terraform, GitHub Actions, Python, uv, wandb

You may be a good fit if you have:

  • 3+ years building and operating production infrastructure at scale, ideally involving compute clusters, distributed training systems, or HPC

  • Hands-on experience with cluster management and workload orchestration systems such as Slurm, Kubernetes, or similar technologies. You've debugged scheduling failures and operated infrastructure where downtime has real cost

  • Experience designing and maintaining CI/CD pipelines, automated testing, and reliable build and deployment workflows

  • Strong systems engineering fundamentals: Linux, networking, storage, and distributed systems. You're comfortable debugging complex infrastructure problems across the stack.

  • Strong Python skills and enough familiarity with training to profile a run and tell whether the bottleneck is data loading, communication, or compute

  • Track record of making infrastructure decisions that measurably improved reliability, developer productivity, or cost efficiency

  • Strong AI tooling skills. You use Claude Code, Cursor, or similar fluently to move fast without sacrificing quality

Bonus:

  • Familiarity with GPU infrastructure, PyTorch, GPU profiling, and distributed training

  • Experience operating at tens-of-millions-scale compute spend

  • Multi-cloud or hybrid HPC/cloud infrastructure experience

  • Experience scaling from single cluster to multi-cluster orchestration

  • Background building experiment tracking, model registries, or ML pipeline tooling

Life at Prior Labs

You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right.

Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together.

Our Commitments

The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are.

We care about how your data is handled - see our Recruiting Data Privacy page

Ready to apply to Prior Labs?
Apply to Prior Labs

How this Platform Engineer salary compares

This role pays $170,005/yr — above the typical range for Platform Engineer roles.

$86,005 median $139,125 $186,021

Typical range $95,965–$170,005/yr, from 15 comparable Platform Engineer listings on JobsRadar (pay annualized to USD). See Platform Engineer salary insights →

Similar jobs

1GLOBAL
DevOps Engineer - Cloud Native Infrastructure
1GLOBAL
⚡ Apply early Lisbon, Lisbon, Portugal Onsite
● New 👁 Seen ✓ Applied 27m ago
Prior Labs
Full Stack Engineer, ML Platform
Prior Labs
⚡ Apply early Berlin Onsite €100,000–€210,000
● New 👁 Seen ✓ Applied 1h ago
Prior Labs
Infrastructure Engineer
Prior Labs
⚡ Apply early Berlin Onsite €100,000–€210,000
● New 👁 Seen ✓ Applied 1h ago
Nebius
Senior Site Reliability Engineer — Token Factory (Inference Platform)
Nebius
⚡ Apply early Amsterdam, Netherlands; Berlin... · location restricted
● New 👁 Seen ✓ Applied 8h ago
Nebius
Senior Backend Software Engineer (Cloud Monetization Platform)
Nebius
⚡ Apply early Amsterdam, Netherlands; Berlin... Onsite
● New 👁 Seen ✓ Applied 8h ago
Nebius
Senior/Staff Site Reliability Engineer (Server Infrastructure)
Nebius
⚡ Apply early Amsterdam, Netherlands; Berlin... · location restricted
● New 👁 Seen ✓ Applied 8h ago
Luminovo
Senior/Staff Platform Engineer, Rust | US Citizen (d/f/m)
Luminovo
⚡ Apply early 🇪🇺 Germany (remote) · location restricted €82,200–€106,800
● New 👁 Seen ✓ Applied 2d ago
DigitalService GmbH des Bundes
Analytics Platform Engineer (all genders)
DigitalService GmbH des Bundes
⚡ Apply early Berlin + hybrid Hybrid
● New 👁 Seen ✓ Applied 5d ago
Innocraft
Senior Infrastructure DevOps Engineer -100% Remote (Germany)
Innocraft
⚡ Apply early Frankfurt · location restricted
● New 👁 Seen ✓ Applied 5d ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Prior Labs

See all jobs at Prior Labs →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free