Jobs Companies Epsilon Labs, Inc. Research Scientist - Vision-Language Modeling

Über diese Research Scientist - Vision-Language Modeling Stelle bei Epsilon Labs, Inc.

Epsilon Labs, Inc. · San Francisco, CA

About Us

We're tackling one of healthcare's most critical challenges in medical imaging and diagnostics. Our company operates at the intersection of cutting-edge AI and clinical practice, building technology that directly impacts patient outcomes. We've assembled one of the industry's most comprehensive and diverse medical imaging datasets and have a proven product-market fit with a substantial customer pipeline already in place.

Role Overview

We're seeking a Research Scientist with deep expertise in Vision Language Modeling (VLMs) to join our ML team. You'll be at the forefront of developing and deploying state-of-the-art multimodal models for clinical use in radiology settings. This role focuses on training and fine-tuning vision-language models (VLMs) that can generate accurate & grounded radiology reports across multiple imaging modalities including X-rays, CT scans, and MRI. You'll work with one of the largest and most diverse medical imaging datasets in the industry, advancing the state-of-the-art in grounded medical report generation, model alignment, and inference-time reasoning while maintaining the clinical rigor required for healthcare deployment.

Key Responsibilities

  • Design, train, and scale vision-language foundation models for radiology applications.

  • Develop and implement advanced post-training strategies including preference optimization (DPO, IPO, KTO), reinforcement learning from human feedback (RLHF), and other alignment techniques to improve clinical accuracy and reduce hallucinations.

  • Research and deploy inference-time compute scaling techniques such as chain-of-thought reasoning, self-refinement, and test-time training to enhance model performance on complex diagnostic cases.

  • Pioneer grounded report generation capabilities, enabling models to spatially localize findings within medical images using bounding boxes or segmentation masks.

  • Design rigorous evaluation frameworks that assess text for medical accuracy and writing style.

  • Contribute hands-on to all stages of model development including dataset curation, architecture design, distributed training, post-training optimization, and production deployment.

  • Stay current with cutting-edge research in vision-language modeling, medical AI, and model alignment techniques.

  • Drive research and technical excellence through conference publications and technical blog posts, establishing best practices for training robust medical VLMs at scale.

Qualifications

  • 6+ years of academia/industry experience in vision-language modeling, multimodal learning, or related fields

  • Deep expertise in training and fine-tuning large vision-language models (e.g., LLaVA, Flamingo, CogVLM, Qwen-VL, or similar architectures)

  • Strong foundation in modern post-training techniques including:

    • Preference optimization methods (DPO, IPO, ORPO, KTO)

    • RLHF and reward modeling

    • Inference-time compute scaling and reasoning strategies

    • Constitutional AI and other alignment techniques

  • Track record of implementing complex models from research papers and adapting them to new domains

  • Proficiency in PyTorch or JAX, with experience training large models on multi-GPU/distributed systems

  • Experience with autoregressive language modeling and instruction tuning

  • Hands-on experience with medical imaging applications, particularly radiology report generation

  • Strong software engineering skills and ability to write production-quality code

Preferred Qualifications

  • Publications at top-tier conferences (NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, MICCAI)

  • Experience with grounded generation tasks (visual grounding, referring expression comprehension)

  • Knowledge of evaluation methodologies for long-form generation, including factuality assessment and hallucination detection

  • Experience with 3D medical image processing and temporal modeling

  • Familiarity with clinical NLP and medical knowledge representation

  • Experience with model interpretability, explainability, and uncertainty quantification in safety-critical applications

Bereit, sich bei Epsilon Labs, Inc. zu bewerben?
Bei Epsilon Labs, Inc. bewerben

Ähnliche Jobs

SA
Manager, Research Scientist
Scale AI
⚡ Früh bewerben San Francisco, CA; New York, N... Vor Ort $290,400–$363,000
● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
Anthropic
People Research Scientist, Recruiting
Anthropic
⚡ Früh bewerben San Francisco, CA | New York C... Vor Ort $285,000–$380,000
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
Anthropic
Research Scientist/Engineer, Biological Safety
Anthropic
⚡ Früh bewerben San Francisco, CA Vor Ort $300,000–$405,000
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
Anthropic
Research Scientist, Life Sciences (Computational)
Anthropic
⚡ Früh bewerben San Francisco, CA Vor Ort $300,000–$320,000
● Neu 👁 Gesehen ✓ Beworben vor 1 Wo.
LS
Principal Scientist / Associate Director, Agentic AI Research for Materials Science
Lila Sciences
⚡ Früh bewerben Cambridge, MA USA; San Francis... Vor Ort $288,000–$420,000
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
SA
Senior / Staff Machine Learning Research Scientist, Agents
Scale AI
⚡ Früh bewerben San Francisco, CA; Seattle, WA... Vor Ort $302,400–$378,000
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
SA
Research Scientist, Frontier Risk Evaluations
Scale AI
⚡ Früh bewerben San Francisco, CA; New York, N... Vor Ort $216,000–$270,000
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
SA
Research Scientist - RL Training
Snorkel AI
⚡ Früh bewerben Redwood City, CA (Hybrid); San... · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
Snowflake
Staff Research Scientist, Exotic AI
Snowflake
⚡ Früh bewerben US-WA-Bellevue Hybrid $236,000–$339,200
● Neu 👁 Gesehen ✓ Beworben vor 2 Std.

Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

Mehr Jobs bei Epsilon Labs, Inc.

Alle Jobs bei Epsilon Labs, Inc. ansehen →

Jetzt bewerben
🤖

Moment — langsam

JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Verschaffe dir einen Vorsprung bei der Jobsuche.

Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

Dem Kanal beitreten — kostenlos