Jobs Companies Judgment Labs Applied AI Engineer

About this Applied AI Engineer role at Judgment Labs

Judgment Labs · Onsite · San Francisco

The Role:

We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

Your research will not live on a whiteboard. You’ll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.

What You'll Do:

  • Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals

  • Design and implement post-training and optimization workflows to improve agents, both internally and for customers

  • Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows

  • Build internal tools and infrastructure that support rapid experimentation, analysis, and training

  • Work closely with product to integrate agents into customer-facing workflows

  • Collaborate with external companies and research partners on frontier AI research

What We're Looking For

Every hire clears three bars, no exceptions:

  • Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.

  • Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.

  • Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.

More specifically, you should bring strength in at least one of the following areas:

  • Data quality, evaluation, benchmarking, and hands-on work with messy production data

  • Agent systems built or evaluated in real-world or production settings

  • Reinforcement learning, post-training, agents, or machine learning fundamentals

  • Infrastructure and systems work across training, data pipelines, evaluation, or model serving

  • Translating research into product while balancing customer constraints, technical tradeoffs, and business impact

  • Turning ambiguous problems into clear, well-designed plans

Ready to apply to Judgment Labs?
Apply to Judgment Labs

Similar jobs

Stitch Fix
ML Platform Engineer
Stitch Fix
⚡ Apply early Remote, USA · location restricted $136,000–$167,000
● New 👁 Seen ✓ Applied 2h ago
Neuralink
Machine Learning Engineer Intern
Neuralink
⚡ Apply early South San Francisco, Californi... Onsite $72,800–$72,800
● New 👁 Seen ✓ Applied 15h ago
UniversalAGI
AI Product Engineer
UniversalAGI
⚡ Apply early San Francisco Onsite
● New 👁 Seen ✓ Applied 16h ago
OpenAI
Machine Learning Engineer, API Multicloud
OpenAI
⚡ Apply early San Francisco Onsite $223,000–$423,000
● New 👁 Seen ✓ Applied 17h ago
Peregrine Technologies
Staff Software Engineer, Applied AI
Peregrine Technologies
⚡ Apply early San Francisco, CA Onsite $200,000–$275,000
● New 👁 Seen ✓ Applied 18h ago
Calico
Senior / Staff Machine Learning Research Engineer
Calico
⚡ Apply early South San Francisco, CA Onsite $220,000–$290,000
● New 👁 Seen ✓ Applied 21h ago
Chime Financial, Inc
Senior AI/ML Engineer
Chime Financial, Inc
⚡ Apply early Chicago, IL, USA; New York, NY... Onsite
● New 👁 Seen ✓ Applied 22h ago
Checkr
Senior Machine Learning Engineer
Checkr
⚡ Apply early San Francisco, California, Uni... Onsite $207,000–$244,000
● New 👁 Seen ✓ Applied 23h ago
DO
Staff Applied AI Engineer
Doximity
⚡ Apply early San Francisco, CA or Remote (U... · location restricted $170,000–$248,000
● New 👁 Seen ✓ Applied 23h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Judgment Labs

See all jobs at Judgment Labs →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free