Jobs › Companies › Wolters Kluwer › Clinical Content Specialist – Clinical AI Evaluation Specialist

Sobre esta vaga de Clinical Content Specialist – Clinical AI Evaluation Specialist na Wolters Kluwer

Wolters Kluwer · Híbrido · USA - Waltham, MA

LOCATION: Hybrid – 8 days a month in the Waltham MA office


OVERVIEW


Wolters Kluwer is seeking a Clinical AI Evaluation Specialist to help ensure that AI-generated clinical content is accurate, evidence-based, relevant, and useful in practice.


This role will conduct systematic evaluations of AI outputs grounded in trusted clinical content. The Evaluation Specialist will apply evidence-based medicine principles, analytical methods, and professional judgment to assess performance, identify patterns, and generate insights that inform system improvement.


This is a professional individual-contributor role within the Clinical AI team. The Evaluation Specialist will independently execute defined evaluation work within the strategy and standards established by Clinical AI leadership. The role is well suited to an individual with graduate training and experience in evidence-based medicine, clinical content development, research methodology, public health, or a related discipline.


RESPONSIBILITIES

AI Evaluation

  • Conduct structured evaluations of AI-generated clinical content.
  • Develop test cases, evaluation criteria, scoring rubrics, and annotation guidance for defined use cases.
  • Evaluate outputs for evidence fidelity, clinical accuracy, relevance, completeness, clarity, and appropriate expression of uncertainty.
  • Apply consistent analytical methods and professional judgment to evaluation decisions.
  • Identify recurring errors, performance gaps, and patterns across clinical topics and question types.
  • Conduct quantitative and qualitative analyses of evaluation results.
  • Document evaluation methods, findings, limitations, and conclusions clearly and reproducibly.
  • Evaluate system performance over time and assess the impact of system changes.

Evidence-Based Content and Clinical Reasoning

  • Apply evidence-based medicine principles to determine how accurately AI outputs represent source content and supporting evidence.
  • Assess whether outputs appropriately synthesize, prioritize, and communicate clinical information.
  • Contribute to evaluation frameworks that reflect the needs of clinicians using AI-supported clinical decision tools.
  • Review clinical content and source materials to develop test cases and inform evaluation decisions.
  • Collaborate with clinical experts when evaluation requires specialized clinical judgment.

Product and System Improvement

  • Translate evaluation findings into clear, actionable insights for Clinical AI, product, engineering, and editorial teams.
  • Contribute evidence and analysis to the refinement of prompts, retrieval approaches, clinical search logic, and content-grounding methods.
  • Inform product and system-development decisions through rigorous evaluation findings.
  • Participate in focused red-teaming, safety testing, and validation activities.
  • Analyze user feedback to identify recurring or systemic performance issues.
  • Contribute to the development of benchmarks and quality standards for evidence-based clinical AI.

Cross-Functional Collaboration

  • Collaborate with Clinical AI Strategists, clinicians, editors, product managers, engineers, and data scientists.
  • Communicate complex findings clearly to clinical, editorial, product, and technical audiences.
  • Present evaluation findings through concise written reports, working sessions, and decision-oriented summaries.
  • Contribute to shared evaluation methods, documentation, and quality standards across the Clinical AI team.
  • Contribute to selected research, publications, and presentations related to clinical AI evaluation.

QUALIFICATIONS


Education: PhD, MPH, or a related graduate degree in clinical epidemiology, public health, health services research, biomedical sciences, clinical informatics, evidence-based medicine, or related field.


Required Experience:

  • Experience in evidence-based medicine, clinical content development, clinical research, systematic evidence assessment, or a related area.
  • Strong analytical skills, including the ability to apply structured evaluation methods, interpret complex findings, and identify meaningful patterns.
  • Excellent written and verbal communication skills, with the ability to explain findings clearly to clinical, editorial, product, and technical audiences.
  • Experience translating evidence or research findings into structured clinical content.
  • Strong attention to detail and commitment to methodological rigor.
  • Ability to independently execute defined work while collaborating effectively across disciplines.
  • Comfort working in an evolving environment with incomplete information and iterative development cycles.
  • Ability to distinguish substantive clinical or evidence problems from issues of wording, organization, or presentation.

Preferred Experience:

  • Training or applied experience in statistics, biostatistics, epidemiology, quantitative research methods, or data analysis.
  • Experience evaluating generative AI, machine-learning systems, clinical decision-support tools, or other digital health products.
  • Familiarity with AI evaluation methods, annotation workflows, benchmark development, error taxonomies, or human-in-the-loop validation.
  • Experience working with medical editors, clinical experts, product teams, engineers, or data scientists.
  • Familiarity with prompt design, retrieval-augmented generation, clinical search, or content-grounded AI systems.
  • Knowledge of patient safety, healthcare quality, or clinical risk principles.

#LI-Hybrid

Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

 

Compensation:

$85,600.00 - $149,400.00 USD

 

This role is eligible for Bonus.

Compensation range listed is based on primary location of the position.  Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process. 

Additional Information:

Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.

Pronto para se candidatar à Wolters Kluwer?
Candidatar-se à Wolters Kluwer

Sobre a Wolters Kluwer

Wolters Kluwer reported 2025 annual revenues of €6.1 billion. The group serves customers in over 180 countries, maintains operations in over 40 countries, and employs more than 21,000 people worldwide. ​ ​ Our customers work in industries that impact the lives of millions of people every single day. Our mission is to empower our professional customers with the AI-powered solutions they need to make critical decisions, achieve successful outcomes, and increase productivity. ​ ​ We deliver trusted, AI-powered expert solutions that combine deep domain knowledge, proprietary content, and advanced technology to provide expert-validated insights, automate workflows, and drive better outcomes. Toda

Ver todas as vagas na Wolters Kluwer →

Vagas semelhantes

Wolters Kluwer
Business Development- Growth Strategy Director
Wolters Kluwer
⚡ Candidate-se cedo USA - Chicago, IL, South LaSal... Presencial $166,900–$298,300
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Associate Director, Technology Product Management- Medi-Span
Wolters Kluwer
⚡ Candidate-se cedo USA-IL-Remote · local restrito $133,400–$238,400
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Senior Enterprise Software Engineer
Wolters Kluwer
⚡ Candidate-se cedo IND-Pune-Smartworks Presencial
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Principal Security Engineer – GenAI Platform
Wolters Kluwer
⚡ Candidate-se cedo NLD - Alphen Aan Den Rijn Presencial
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Senior Legal Counsel - Cybersecurity
Wolters Kluwer
⚡ Candidate-se cedo USA - New York City, NY Híbrido $128,900–$226,050
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Senior Product Manager, Health Research Analytics
Wolters Kluwer
⚡ Candidate-se cedo USA - Philadelphia, PA Presencial $94,200–$164,450
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Sales Business Retention Representative
Wolters Kluwer
⚡ Candidate-se cedo USA - Columbus, OH Presencial $47,600–$81,250
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Sales Support Specialist - Law Firm Sales
Wolters Kluwer
⚡ Candidate-se cedo USA-TX-Remote · local restrito $57,400–$98,350
● Nova 👁 Vista ✓ Candidatada há 2d
Wolters Kluwer
Senior Full Stack Engineer, AI Platform & Agents
Wolters Kluwer
⚡ Candidate-se cedo NLD - Alphen Aan Den Rijn Presencial
● Nova 👁 Vista ✓ Candidatada há 2d

Cadastre-se para receber sugestões sob medida com base nas vagas que você abre e nas buscas que você salva.

Mais vagas na Wolters Kluwer

Ver todas as vagas na Wolters Kluwer →

Candidatar-se agora
🤖

Opa — calma aí

A JobsRadar foi feita para pessoas de verdade passando por um momento difícil na busca por emprego — não para requisições automatizadas. Você está clicando rápido demais e agora está temporariamente bloqueado.

Volte mais tarde. Se você está mesmo procurando emprego, estamos com você — apenas aja como um ser humano.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Ganhe vantagem na sua busca por emprego.

Entre no nosso canal do Telegram para o que ajuda você a conseguir a vaga — referências salariais, o pulso semanal do mercado e avisos de novos recursos. Sem spam, só sinal.

Entre no canal — é grátis