Jobs Companies Arcada Labs Incorporated Member of Technical Staff, Frontier Evals

Über diese Member of Technical Staff, Frontier Evals Stelle bei Arcada Labs Incorporated

Arcada Labs Incorporated · Vor Ort · San Francisco

Why join Intelligence

Mission: Give every human superintelligence, and make superintelligence more human.

Intelligence is the product lab company behind DesignArena - 5.5M+ users in 8 months, leaderboard referenced by Andrew Ng, Elon Musk, Demis Hassabis, and more. The team is incredibly talent-dense (11 from Harvard + Berkeley), backed by Tier 1 VC Index Ventures, YC, SV Angel, Lenny Rachitsky, Paul Graham, Dylan Field, and one of the fastest-growing seed-stage startups in SF.

Behind closed doors, we see what the models can do six months before the world does. We are trusted by the best frontier model providers like OpenAI to rigorously evaluate the capabilities of state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, slide generation, and more, through the large-scale platforms that we’ve built.

Design Arena, our flagship product, is the most referenced benchmark for AI-generated visuals, and is powered by over 5.3M+ authentic users across 192 countries. Prediction Arena was the first time models traded autonomously with real cash on real-time, real-world events. Social Arena tested whether AI models can effectively grow and engage audiences on X by having them operate as independent social media agents.

Role

You'll define how frontier AI models are measured. You'll design new benchmarks, run experiments, analyze model behavior, and build evaluation methodologies that become trusted signals for the industry. Your work will shape our public leaderboards and the evaluation tools we share with frontier labs.

Here’s an example of a piece of industry-leading work done in this field. This is a SOTA STS benchmark, advised by OpenAI: https://audioarena.ai/. Email us for the pre-print.

What You’ll Own

  • Your work will be tracked and followed by the likes of Elon Musk, Mark Zuckerberg, Alexandr Wang, Demis Hassabis, Andrew Ng, Amjad Massad, and more

  • Design genuinely hard and useful evaluations that measure frontier model performance on real-world tasks, and that become industry-leading gold-standards

  • Investigate model failures and identify what they reveal about emerging capabilities

  • Publish research, technical reports, and analyses that shape how frontier models are evaluated

What We’re Looking For

  • Strong STEM background. You studied Computer Science, Data Science, Statistics, Math, Engineering, Physics, or a related field.

  • Deep curiosity about frontier AI models. You're excited by understanding model behavior, discovering areas of failure, and building better ways to evaluate models.

  • Genuine thirst and intellectual to be on the frontier of AI development.

  • Fearlessness to roll up your sleeves, get your hands dirty, and do real work.

Details

  • Location: San Francisco, Levi’s Plaza. We sponsor visas and handle relocation.

  • Work Schedule: Sunday-Friday. Saturdays are yours!

  • Compensation: Competitive salary + meaningful equity. You'd be joining at the stage when ownership matters most.

Bereit, sich bei Arcada Labs Incorporated zu bewerben?
Bei Arcada Labs Incorporated bewerben

Ähnliche Jobs

Arcada Labs Incorporated
Member of Technical Staff, ML Engineer
Arcada Labs Incorporated
⚡ Früh bewerben San Francisco Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 1 Tg.
Arcada Labs Incorporated
Member of Technical Staff, Product Engineering
Arcada Labs Incorporated
⚡ Früh bewerben San Francisco Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 1 Tg.
Arcada Labs Incorporated
Member of Technical Staff, Post-Training Research & Data
Arcada Labs Incorporated
⚡ Früh bewerben San Francisco Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
Arcada Labs Incorporated
Open Application
Arcada Labs Incorporated
⚡ Früh bewerben San Francisco Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
Charlotte Tilbury
Sales and Artistry Coordinator - San Francisco & East Bay
Charlotte Tilbury
⚡ Früh bewerben San Francisco, California, Uni... Vor Ort $70,000–$75,000
● Neu 👁 Gesehen ✓ Beworben vor 5 Std.
HireHawk
Lead Research Specialist (Remote) | LATAM
HireHawk
⚡ Früh bewerben Mexico City, Mexico City, Mexi... · standortgebunden $18,000–$24,000
● Neu 👁 Gesehen ✓ Beworben vor 5 Std.
Botrista
Demand Planning & Product Lifecycle Lead
Botrista
⚡ Früh bewerben New York, New York, United Sta... Vor Ort
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Golden Gate Regional Center
Communication Specialist
Golden Gate Regional Center
⚡ Früh bewerben San Francisco, California, Uni... Vor Ort $75,518–$90,621
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Wispr Flow
Software Engineer, Labs
Wispr Flow
⚡ Früh bewerben San Francisco Vor Ort $180,000–$300,000
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.

Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

Mehr Jobs bei Arcada Labs Incorporated

Alle Jobs bei Arcada Labs Incorporated ansehen →

Jetzt bewerben
🤖

Moment — langsam

JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Verschaffe dir einen Vorsprung bei der Jobsuche.

Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

Dem Kanal beitreten — kostenlos