Jobs › Companies › Thomson Reuters › Senior/Lead Research Scientist, Model Evaluations

Sobre esta vaga de Senior/Lead Research Scientist, Model Evaluations na Thomson Reuters

Thomson Reuters · Híbrido · Switzerland, Zug, Zug

Job Description


Thomson Reuters Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows.


See the detailed technical report for more information on the latest model release: Thomson 1.0 Technical Report on Hugging Face.


The evaluation team focuses on providing signal for model development and adoption using a combination of benchmarks and targeted evaluations to assess performance on highly complex legal and professional workflows. The team works with legal experts to adapt their expertise into benchmarks and with product leaders to ensure model capabilities are aligned with real, user-facing flows in professional work.


As a research scientist on the team, you would be working with researchers to design, develop, optimize and scale the evaluation suite as Thomson scales to newer releases and product integrations. You’ll work in cutting edge areas of AI development, such as multi-agent systems and decision models to keep the Thomson model suite at the frontier of specialized professional LLMs.


Key Responsibilities

  • Build and operate the evaluation suite that runs Thomson evaluations. Leverage our existing suite to identify and understand the strengths and weakness of Thomson. Create new evaluations to meet the gaps in our coverage, based on a combination of product, external, and aspirational use cases for the model.
  • Lead cross-functional teams in the creation of evaluation assets. Use your technical expertise to guide teams of scientists, engineers, and subject-matter experts working on evaluations and benchmarks. Mentor junior scientists in developing their own research and technical skills.
  • Inform the technical direction of Thomson. Propose opportunities for improvements on topics such as more robust and reliable evaluation, new opportunities for applying LLMs, and optimizations on existing assets. Draw on evaluation results to inform our training objectives. Provide recommendations to senior leadership on technical trade-offs in model development.
  • Conduct fundamental research. Develop new ideas in model evaluation across science of evaluations, new benchmarks, and safety and alignment. Publish research findings in top AI/ML/NLP conferences on a regular cadence. Integrate new research findings into model development and product pipelines.

Required Qualifications

  • Hands-on research experience in evaluations – with examples of designing, building and releasing benchmarks for frontier models or agents, including research publications in top conferences such as NeurIPS/ICML/ICLR/*ACL.
  • Experience working closely with researchers and cross-functional stakeholders to translate ideas into practical evaluations.
  • Hands-on Python coding experience implementing benchmarks, agents or other systems built around LLMs.
  • Familiarity with current developments in LLMs, with an interest in staying up to date with the evolving frontier.
  • A PhD in Computer Science or a related field, or equivalent practical experience, plus industry experience working on post-training or evaluation. Professional experience will be considered as a factor for levelling between Senior and Lead.

Preferred Qualifications

  • Experience working with specialized domain experts in areas such as law, tax, or similar professions is especially desirable.
  • Familiarity with AI-assisted coding and with leveraging coding agents at scale to accelerate work.
  • Experience in experimental design and best practices for working with human data.


Even if you don’t have all the above requirements, we encourage you to apply to explore a mutual fit!


#LI-FP3


 

 


What’s in it For You?

  • Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.
  • Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
  • Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
  • Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
  • Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
  • Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
  • Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.

DISCLAIMER

The above information in this description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job.


 

 

About Us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news.

We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward.

As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.

We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here.

Learn more on how to protect yourself from fraudulent job postings here.

More information about Thomson Reuters can be found on thomsonreuters.com

Pronto para se candidatar à Thomson Reuters?
Candidatar-se à Thomson Reuters

Sobre a Thomson Reuters

At Thomson Reuters, we’re not riding the AI wave — we’re reshaping the future of professional work across law, tax, compliance, and journalism. Here, you will collaborate with smart, ambitious people who thrive on solving complex problems, delivering market-leading solutions, and innovating with curiosity and care. Learn more about a career with us 📖 Our Employer Story 🔍 Inside Thomson Reuters Blog 🏆 Awards and Recognition 🌱 Join Our Talent Community ✅ Protect Your Job Search

Ver todas as vagas na Thomson Reuters →

Vagas semelhantes

Thomson Reuters
Lead/Senior Research Scientist – Agentic Reinforcement Learning
Thomson Reuters
⚡ Candidate-se cedo Switzerland, Zug, Zug Híbrido
● Nova 👁 Vista ✓ Candidatada há 10h
MongoDB
Staff Research Scientist
MongoDB
⚡ Candidate-se cedo Palo Alto Presencial $151,000–$297,000
● Nova 👁 Vista ✓ Candidatada há 1h
MongoDB
Senior Research Scientist
MongoDB
⚡ Candidate-se cedo Palo Alto Presencial $126,000–$248,000
● Nova 👁 Vista ✓ Candidatada há 1h
OpenAI
Applied Scientist, Product Policy Research & Measurement
OpenAI
⚡ Candidate-se cedo San Francisco Híbrido $347,000–$385,000
● Nova 👁 Vista ✓ Candidatada há 7h
Q Ctrl
Staff Research Scientist — Quantum Algorithms & Fault-Tolerant Applications
Q Ctrl
⚡ Candidate-se cedo Los Angeles Híbrido $185,000–$265,000
● Nova 👁 Vista ✓ Candidatada há 8h
Q Ctrl
Senior Research Scientist, Quantum Error Correction
Q Ctrl
⚡ Candidate-se cedo Los Angeles Híbrido $150,000–$225,000
● Nova 👁 Vista ✓ Candidatada há 8h
Q Ctrl
Senior Research Scientist, Superconducting Hardware
Q Ctrl
⚡ Candidate-se cedo Los Angeles Híbrido $150,000–$225,000
● Nova 👁 Vista ✓ Candidatada há 8h
AX
Research Scientist II
Axon
⚡ Candidate-se cedo Ho Chi Minh City, Ho Chi Minh... Híbrido
● Nova 👁 Vista ✓ Candidatada há 8h
KRAFTON
[AI Research Div.] Research Scientist - Foundation Models (2년 이상 / 계약직)
KRAFTON
⚡ Candidate-se cedo Seoul Presencial
● Nova 👁 Vista ✓ Candidatada há 8h

Cadastre-se para receber sugestões sob medida com base nas vagas que você abre e nas buscas que você salva.

Mais vagas na Thomson Reuters

Ver todas as vagas na Thomson Reuters →

Candidatar-se agora
🤖

Opa — calma aí

A JobsRadar foi feita para pessoas de verdade passando por um momento difícil na busca por emprego — não para requisições automatizadas. Você está clicando rápido demais e agora está temporariamente bloqueado.

Volte mais tarde. Se você está mesmo procurando emprego, estamos com você — apenas aja como um ser humano.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Ganhe vantagem na sua busca por emprego.

Entre no nosso canal do Telegram para o que ajuda você a conseguir a vaga — referências salariais, o pulso semanal do mercado e avisos de novos recursos. Sem spam, só sinal.

Entre no canal — é grátis