This role is for one of our clients

Compensation: $150 per hour

We are seeking board-certified psychiatrists to support an expert evaluation project with a leading AI research organization.

The project focuses on assessing how effectively advanced AI systems reason through complex psychiatric scenarios. As a Psychiatry Expert, you will use your clinical expertise to develop challenging, expert-level diagnostic and reasoning tasks, establish authoritative reference answers, and identify common weaknesses in AI-generated clinical reasoning.

Psychiatrists from a range of practice settings are welcome, with particular interest in professionals with specialized expertise in psychiatry subspecialties.

Requirements

Key Responsibilities

• Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems.
• Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning.
• Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations.
• Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns.
• Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks.
• Collaborate directly with AI research teams and other subject-matter experts.
• Apply current clinical knowledge and professional judgment consistently when evaluating model outputs.

Required Qualifications

• Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program. Current trainees do not qualify.
• Medical degree: MD or DO. International medical degrees from recognized institutions are also eligible.
• Active board certification in psychiatry, such as:
• ABPN
• FRCPC
• MRCPsych
• FRANZCP
• Recognized national equivalent

• Board-eligible or lapsed certifications do not meet the requirement.
• Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action.
• 3+ years of independent clinical practice after residency, either currently or within the past two years. Residency and fellowship training do not count toward this requirement.
• Current or recent practice in an accredited or government-licensed clinical setting, including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations.
• Must be based in the United States, United Kingdom, Europe, or Australia. US-based candidates are preferred.
• Psychiatry must be the primary area of professional practice.

Preferred Qualifications

The following qualifications are valued but are not mandatory:

• 10+ hours per week of direct patient care, currently.
• Specialized expertise in one or more of the following areas:
• Addiction Psychiatry
• Child & Adolescent Psychiatry
• Forensic Psychiatry
• Geriatric Psychiatry
• Consultation-Liaison Psychiatry

• Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice.
• Experience developing or administering OSCEs, including examiner or assessment-development experience.
• Current or recent faculty appointment within a psychiatry department.
• Experience reviewing, evaluating, grading, or developing clinical or medical educational content.

Role Responsibilities

As part of the engagement, you may be asked to:

• Develop clinically challenging psychiatric scenarios for AI evaluation.
• Produce authoritative answers with transparent and well-structured clinical reasoning.
• Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases.
• Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment.
• Identify recurring failure modes in AI reasoning and communicate them clearly to research teams.
• Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards.

Screening Process

Qualified candidates will complete a 20–30 minute structured interview.

The screening conversation will focus on your clinical background, independent practice experience, psychiatric specialization, and relevant subspecialty expertise.

Engagement Details

• Role: Psychiatry Expert
• Work Arrangement: Fully Remote
• Engagement Type: Independent Contractor
• Location Eligibility: US, UK, Europe, or Australia
• Projects may be extended, shortened, or concluded based on project requirements and performance.
• Payments are made weekly based on services rendered through available payment platforms.
• The engagement does not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
• H-1B and STEM OPT candidates are not currently supported.