Position Overview 

We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation. 

Primary Responsibilities 

• Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum 

• Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility 

• Provide expert feedback to ensure content meets the learning needs of first and second-year medical students 

• Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload) 

• Participate in quarterly evaluation cycles with potential for ad-hoc assessments 

Required Qualifications 

Candidates must meet ONE of the following criteria: 

• Current PGY-1 resident in a US medical residency program (MD or DO degree), OR 

• Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2 

Preferred Qualifications 

• Prior experience in medical education content review 

• Strong understanding of medical education pedagogy and learning outcomes 

Time Commitment 

• 5-15 hours per week during active evaluation periods 

• Minimum of 4 evaluation cycles per year 

Project Details 

• Duration: November 2025 – December 2026 (with possibility of extension) 

• Start Date: First evaluation round begins November 5, 2025 

• Compensation: $60 USD per hour 

• Work Arrangement: Remote (US time zones) 

• Contract Structure: Employment through third-party contracting agency