Jobs Companies Nebius Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Über diese Senior Applied Scientist, Efficient LLM Inference & Model Optimization Stelle bei Nebius

Nebius · Vor Ort · Palo Alto, California, United States

About Nebius:

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role 

Nebius Token Factory needs scientists who can turn frontier inference bottlenecks into research problems, publish credible work, and then help ship the results into production. This is not a papers-only research role. The Applied Scientist is expected to design rigorous experiments, write strong code, collaborate with engineers, and convert research into deployed inference capabilities.

A Senior Applied Scientist owns well-scoped research and production optimization projects. They can publish or prepare high-quality technical work while also producing code, experiments, and prototypes that engineers can use.

Your responsibilities: 

  • Own focused research projects from hypothesis through experiment, ablation, prototype, and production handoff.

  • Prepare internal reports, technical blogs, or papers when the work is externally credible.

  • Partner directly with MLEs to ensure research prototypes become usable production components.

  • Define and execute research programs in efficient LLM and VLM inference with measurable production impact.

  • Invent, evaluate, and productionize methods for quantization, QAT, distillation, speculative decoding, KV-cache reuse, KV-cache compression, long-context inference, MoE routing, and model/runtime co-optimization.

  • Build high-quality prototypes in PyTorch, Triton, CUDA-adjacent tooling, or inference-serving frameworks, then work with MLEs and platform engineers to productionize them.

  • Design rigorous evaluation methodology covering quality, latency, throughput, numerical stability, memory footprint, tail latency, and cost per token.

  • Publish papers, technical reports, blog posts, and open-source artifacts that build external credibility for Nebius Token Factory.

  • Collaborate with MLE, GPU kernel, backend infrastructure, product, and customer teams to choose high-leverage research bets.

  • Mentor engineers and scientists on experimental design, scientific rigor, and model/system tradeoffs.

Must-haves: 

  • PhD in computer science, machine learning, ML systems, computer systems, computer architecture, electrical engineering, applied math, or a closely related field.

  • Strong publication record or equivalent research artifacts in ML, ML systems, efficient inference, model compression, quantization, distillation, serving systems, or related areas.

  • Strong hands-on coding ability in Python and PyTorch; ability to move from idea to experiment to prototype quickly.

  • Deep understanding of LLMs, VLMs, transformer inference, decoding algorithms, model compression, quantization, and production-serving tradeoffs.

  • Strong experimental design skills, including ablations, baselines, metrics, statistical reasoning, and failure analysis.

  • Excellent written and verbal communication.

Nice-to-haves: 

  • First-author publications in NeurIPS, ICML, ICLR, MLSys, ACL, EMNLP, ASPLOS, OSDI, SOSP, ISCA, HPCA, or comparable venues.

  • Experience deploying ML models or inference optimizations in production.

  • Experience with vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo, FlashAttention, FlashInfer, Triton, CUDA, or PyTorch internals.

  • Experience with post-training, SFT, DPO, RLHF, RLAIF, preference optimization, or synthetic data generation when connected to inference quality or efficiency.

  • Open-source research artifacts, widely used benchmarks, high-quality technical blogs, or invited talks in efficient AI systems.

Key employee benefits in the US:

  • Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.

  • 401(k) plan: Up to 4% company match with immediate vesting.

  • Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.

  • Remote work reimbursement: Up to $85/month for mobile and internet.

  • Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.

 

Pay Transparency

We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.

Base Compensation Range
$195,200$262,200 USD

Benefits & Perks:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

What's it like to work at Nebius:

Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI 

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire. 

If you need accommodations during the application process, please let us know.

Bereit, sich bei Nebius zu bewerben?
Bei Nebius bewerben

Wie sich dieses Gehalt für Data Scientist vergleicht

Diese Stelle zahlt $228,700/yrim Einklang mit der üblichen Spanne für Data Scientist Stellen.

$112,645 dem Median $190,000 $271,065

Übliche Spanne $149,875–$229,375/yr, aus 709 vergleichbaren Data Scientist Anzeigen auf JobsRadar (Vergütung auf USD hochgerechnet). Gehaltseinblicke für Data Scientist ansehen →

Ähnliche Jobs

EX
Lead Data Scientist, Revenue Analytics
Extend
⚡ Früh bewerben Remote, US · standortgebunden $138,750–$150,000
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Roku
Senior Data Scientist
Roku
⚡ Früh bewerben San Jose, California Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Roku
Senior Data Scientist
Roku
⚡ Früh bewerben New York, New York Vor Ort $127,500–$170,400
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Roku
Senior Research Data Scientist
Roku
⚡ Früh bewerben New York, New York Vor Ort $330,000–$375,000
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Stripe
Data Scientist, Core Infrastructure
Stripe
⚡ Früh bewerben San Francisco Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 7 Std.
Realtor.com Careers
Senior Data Scientist, Search & NLP
Realtor.com Careers
⚡ Früh bewerben Austin, Texas, United States Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 7 Std.
Realtor.com Careers
Sr. Data Scientist, Product Analytics
Realtor.com Careers
⚡ Früh bewerben Austin, Texas, United States Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 7 Std.
Revolution Medicines
Senior Machine Learning Scientist I, Drug Discovery Analytics
Revolution Medicines
⚡ Früh bewerben Redwood City, California, Unit... Vor Ort $229,000–$269,000
● Neu 👁 Gesehen ✓ Beworben vor 8 Std.
Revolution Medicines
Senior Machine Learning Scientist II, Drug Discovery Analytics
Revolution Medicines
⚡ Früh bewerben Redwood City, California, Unit... Vor Ort $251,000–$295,000
● Neu 👁 Gesehen ✓ Beworben vor 8 Std.

Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

Mehr Jobs bei Nebius

Alle Jobs bei Nebius ansehen →

Jetzt bewerben
🤖

Moment — langsam

JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Verschaffe dir einen Vorsprung bei der Jobsuche.

Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

Dem Kanal beitreten — kostenlos