Jobs › Companies › Ambral › Member of Technical Staff (Evals & Post-Training)

À propos de ce poste Member of Technical Staff (Evals & Post-Training) chez Ambral

Ambral · Sur site · New York

What we do

Ambral Labs helps enterprises own the intelligence behind their most important workflows.

Every company has years of historical evidence showing how work gets done: the context people had, the decisions they made, the actions they took, and the outcomes that followed. Today, most of that history is inert. It isn’t structured in a way that companies can use to evaluate models and improve agent behavior.

Ambral turns this history into replayable environments and eval sets grounded in real workflows and observed outcomes. We use those environments to improve model performance through reinforcement learning and other post-training techniques, alongside context engineering, harness design, and agent engineering.

The result is better, more cost-efficient AI for each enterprise’s specific work, powered by open-weight models that the company owns and controls. This allows each company to retain ownership of its core intelligence instead of outsourcing it to a model provider.

We graduated from YC S2025, raised millions in funding, and are already deployed within multi-billion dollar enterprises. Now we're growing the founding team

 

What you’ll do

At the center of Ambral Labs is a replayable environment engine for the enterpirse.

The system reconstructs a company’s world as it existed at a particular moment in the past then exposes that state through the same tools an agent would use in production. This lets us place new policies and agent configurations inside real historical environments, observe how they reason and act, and grade their performance against real outcomes.

You'll work across research, infrastructure, and production systems including:

  • Building an environment factory that converts recorded enterprise data and task definitions into runnable environments

  • Designing graders that turn ambiguous business objectives into verifiable rewards

  • Developing methods for mining useful tasks, trajectories, and evaluation cases from historical workflows

  • Creating eval sets that are representative, reproducible, and resistant to overfitting

  • Finding the right combinations of models, tools, context, and policies to maximize performance while reducing inference cost

  • Training and evaluating agents that operate over long horizons, incomplete information, and large tool spaces

  • Building replay and observability systems that make agent behavior explainable and measurable

  • Scaling from individual environments to thousands of concurrent training and evaluation runs

These problems are wide open. You’ll have significant ownership over both the research direction and the production systems that make it real.

You’ll work directly with the CTO, deploy into real enterprise workflows, and see your research tested against consequential problems and observable outcomes.

 

Who you are

  • You have 1-7 years of experience building production software or machine-learning systems (we're hiring at multiple levels for this role).

  • Bonus points for working on reinforcement-learning environments, LLM post-training, evaluation infrastructure, agent harnesses, or closely related systems

  • You understand how environment design, reward design, context, tooling, and policy behavior interact

  • You’re comfortable turning fuzzy business objectives into tasks and signals that can be evaluated reliably

  • You can diagnose whether a model’s limitations come from the model itself, its context, its tools, its harness, or its training

  • You can move between research questions and production implementation without treating them as separate jobs

  • You write strong software and can build systems that process large, messy datasets at scale

  • You care about reproducibility, observability, and understanding why a model behaves the way it does

  • You’re looking to do the best work of your life and build something you’ll be proud of for decades

We care much more about what you’ve built and how you think than credentials or conventional career paths.

Benefits

  • Significant equity and ownership

  • Equinox membership

  • Free meals, coffee, and snacks

  • Health insurance

  • Unlimited PTO

Prêt à postuler chez Ambral ?
Postuler chez Ambral

Emplois similaires

Ambral
Head of Research
Ambral
⚡ Postuler tôt New York Sur site $250,000–$400,000
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
Ambral
Member of Technical Staff (New Grad)
Ambral
⚡ Postuler tôt New York Sur site $140,000–$175,000
● Nouveau 👁 Vu ✓ Postulé il y a 2 mois
Bank of America
Global Financial Crimes Specialist
Bank of America
⚡ Postuler tôt Charlotte Sur site $68,500–$128,300
● Nouveau 👁 Vu ✓ Postulé il y a 31 min
Bank of America
Registered Wealth Management Client Associate
Bank of America
⚡ Postuler tôt New York Sur site $52,000–$93,600
● Nouveau 👁 Vu ✓ Postulé il y a 31 min
JLL
Senior Executive Assistant
JLL
⚡ Postuler tôt New York, NY Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 46 min
Trinity Health
Environmental Aide II - Albany Memorial Hospital - Full Time - Evenings
Trinity Health
⚡ Postuler tôt Albany Memorial Hospital - Alb... Sur site $34,736–$42,349
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
Trinity Health
Pre/Post Cath Lab RN
Trinity Health
⚡ Postuler tôt St. Peter's Hospital - Albany,... Sur site $83,200–$83,200
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
PwC
Risk Modeling Services - AI Data Scientist Director
PwC
⚡ Postuler tôt NY-New York Sur site $134,000–$410,000
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
PwC
Financial Markets & Real Estate - Real Estate Valuation Senior Associate
PwC
⚡ Postuler tôt NY-New York Sur site $72,000–$212,000
● Nouveau 👁 Vu ✓ Postulé il y a 1 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Ambral

Voir tous les emplois chez Ambral →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit