Jobs › Companies › Kled AI › Research Scientist, Benchmarks & Evals

About this Research Scientist, Benchmarks & Evals role at Kled AI

Kled AI · Remote · United States

ABOUT KLED

Kled is building the largest opt-in human data network in the world.

We are not a labeling firm. We are not a task marketplace.

We are a consumer application where people upload their real photos, videos, and documents and get paid continuously.

We then filter, standardize, and license that data to frontier AI labs and enterprises that need fresh, rights-aware training data.

Since launching our mobile app in 2026, we have:

• Reached #1 on the App Store (Finance) with 0 paid marketing
• Scaled to 600,000+ active data contributors
• Processed 5M uploads per day
• Raised $15M+ from investors behind SpaceX, Airbnb, Coinbase, xAI, OpenAI, Anthropic, Spotify, Lyft, Uber, and more

Our mission is to let anyone download the app and earn a real living wage from uploading their data.

ABOUT THE ROLE

Research Scientist - Benchmarks & Evals

AI labs buy data when a benchmark shows it works.

You’ll build the benchmarks that show what one of the largest human data networks in the world can do for frontier AI models.

You will:

- Design and ship public benchmarks for image, video and document models

- Build private test sets from real, opt-in data that no model has trained on

- Run data-value experiments: train models with and without Kled data, measure what changes

- Design human evaluation studies and the automatic metrics that track them

- Publish leaderboards and reports that researchers at frontier labs trust

- Find where models fall short and tell our team what data to collect next

- Work directly with the founders and lab buyers to turn results into data deals

WE’RE LOOKING FOR

- 3+ years ML research or research engineering experience

- A benchmark or evaluation you built that other people actually used

- Strong hands-on experience training and fine-tuning image or video models (PyTorch)

- Deep understanding of experimental design and statistics (controls, ablations, human studies)

- Experience running experiments end to end, from GPUs to final report

- Clear writing for both researchers and buyers

Bonus:

- Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially)

- Experience on an evaluation or data team at an AI lab

- Experience selling or licensing data to AI labs

- Experience with data valuation or data attribution research

CURRENT STACK

Research

- Python / PyTorch

- Open-weight image and video models

- Cloud GPUs

Data

- Hundreds of millions of opt-in photos, videos and documents

- PostgreSQL (Supabase)

- S3 storage

COMPENSATION

- Base salary: $150,000 - $250,000

- $350,000 – $750,000 equity

We move fast and work hard.

If you're excited to build the benchmarks that decide what data trains frontier AI, let’s talk!

GROWTH OPPORTUNITY

You’ll join a team operating at the frontier of applied AI data infrastructure.

In this role, you’ll have the opportunity to:

• Own core systems that power one of the largest human data networks in the world
• Design infrastructure that directly influences what data trains next-generation AI models
• Build at real scale - millions of uploads per day, adversarial environments, global contributors
• Ship alongside a team that has built marketplaces, AI systems, and products used by millions

If you’re excited to move fast, build systems that matter, and help define how human data powers frontier AI, let’s talk.

Ready to apply to Kled AI?
Apply to Kled AI

How this Research Scientist salary compares

This role pays $200,000/yr — in line with the typical range for Research Scientist roles.

$89,100 median $200,000 $350,000

Typical range $134,850–$262,375/yr, from 244 comparable Research Scientist listings on JobsRadar (pay annualized to USD). See Research Scientist salary insights →

Similar jobs

adaption
Research Scientist
adaption
⚡ Apply early United States · location restricted
● New 👁 Seen ✓ Applied 10h ago
Wealthfront
People Research Scientist
Wealthfront
⚡ Apply early Palo Alto, CA Hybrid
● New 👁 Seen ✓ Applied 2d ago
Field Ai
Senior Research Scientist, Humanoid Manipulation
Field Ai
⚡ Apply early Boston, MA Onsite
● New 👁 Seen ✓ Applied 2d ago
Edmentum
Research Scientist, Applied AI Research
Edmentum
⚡ Apply early United States Onsite $90,000–$100,000
● New 👁 Seen ✓ Applied 2d ago
Precision Medicine Group
Associate Research Scientist, Real World Evidence
Precision Medicine Group
⚡ Apply early Remote, United States · location restricted $66,000–$94,000
● New 👁 Seen ✓ Applied 2d ago
Precision AQ
Associate Research Scientist, Real World Evidence
Precision AQ
⚡ Apply early Remote, United States · location restricted $66,000–$94,000
● New 👁 Seen ✓ Applied 2d ago
Nuro
ML Research Scientist, Prediction & Smart Agents
Nuro
⚡ Apply early Mountain View, California (HQ) Onsite $193,930–$291,150
● New 👁 Seen ✓ Applied 2d ago
Nuro
Senior/Staff Machine Learning Research Scientist: Generative Modeling for Planning
Nuro
⚡ Apply early Mountain View, California (HQ) Onsite $193,930–$352,290
● New 👁 Seen ✓ Applied 2d ago
Nuro
Machine Learning Research Scientist: Generative Modeling for Planning
Nuro
⚡ Apply early Mountain View, California (HQ) Onsite $160,360–$240,540
● New 👁 Seen ✓ Applied 2d ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Kled AI

See all jobs at Kled AI →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free