Jobs Companies The Bot Company Machine Learning: Multimodal Foundation Models

About this Machine Learning: Multimodal Foundation Models role at The Bot Company

The Bot Company · Onsite · San Francisco

The Bot Company

We're building a helpful robot for every home.

We're a small team of engineers, designers, and operators based in San Francisco. Our team comes from Tesla, Cruise, OpenAI, Google, Pixar, and many other great companies. In the past we've shipped to hundreds of millions of users and know what it takes to build amazing products and experiences.

Our team is deliberately lean to promote rapid decision making and do away with bureaucracy and hierarchy. Everyone is an IC and is empowered with massive scope, radical ownership, and direct responsibility. We work across the stack with a culture built for rapid iteration and fast execution.

What we look for in all candidates

All roles at The Bot Company demand extreme sharpness and the ability to move fast in high-intensity environments. Throughout the process, we expect candidates to demonstrate:

  • Exceptional mental acuity: you think quickly, learn instantly, and reason across unfamiliar domains.

  • Engineering curiosity: you naturally dig into how systems work, even outside your specialty.

  • High performance mindset: you move fast, handle ambiguity, and excel when the environment is demanding.

Machine Learning: Multimodal Foundation Models

We are building unified foundation models that natively reason across text, image, video, and kinematics to drive intelligent robotic policies.

You will work on large multi-modal networks and own the entire stack from data to training and deploying models.

What You'll Do

  • Build Native Multimodal Policies: Develop architectures where vision, language, and more modalities share a unified representation.

  • Improve Cross-Modal Reasoning: Research and implement methods to ensure the model doesn't just "associate" modalities but actually reasons through them (e.g., grounding visual physics in kinematic constraints).

  • Own the Training Loop End-to-End: Design, run, debug, and iterate on large-scale training experiments; diagnosing failure modes, improving data mixtures, and tightening evaluation to drive measurable gains.

  • Ship and Iterate on Real Systems: Integrate models into real robotic stacks, build on robot code to deploy your models, and optimize performance for edge inference.

Requirements

  • Very strong coding skills in Python, C++, or Rust.

  • Production MLLM Experience: Track record of training and deploying large-scale multimodal models.

  • Pretraining & RL Mastery: Deep intuition for LLM-style pretraining, post-training, and Reinforcement Learning at scale.

  • Infrastructure Fluency: Comfortable managing and optimizing large-scale experiments on massive GPU clusters.

Why Join

You’ll work with a small, elite team on challenges that require speed, intelligence, and deep engineering instinct. If you enjoy understanding systems at all levels, move fast, and think even faster, you’ll thrive here.

Ready to apply to The Bot Company?
Apply to The Bot Company

Similar jobs

TB
Machine Learning: Whole-Body Control
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
TB
Machine Learning: World Models
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
TB
ML Infra - Data Infrastructure
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
TB
3D Vision
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
TB
Mechanical
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
TB
Something Else
The Bot Company
⚡ Apply early San Francisco Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 4w ago
Pacific Aviation
Dispatch Manager Flight Operations
Pacific Aviation
⚡ Apply early San Francisco, California, Uni... Onsite
● New 👁 Seen ✓ Applied 6h ago
Pacific Aviation
Aircraft Flight Dispatcher - SFO
Pacific Aviation
⚡ Apply early San Francisco, California, Uni... Onsite $52,832–$52,832
● New 👁 Seen ✓ Applied 6h ago
Valkai
Member of Technical Staff - Product Engineering
Valkai
⚡ Apply early New York City Onsite $200,000–$350,000
● New 👁 Seen ✓ Applied 7h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at The Bot Company

See all jobs at The Bot Company →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free