About this Film & Video Craft Expert role at Weekday AI
This role is for one of our clients
Compensation: $70 - $100 per hour
Role Type: Independent Contractor
Work Arrangement: Fully Remote
Time Commitment: Minimum 20 hours per week
Payment Frequency: Weekly
Role Overview
Join a leading AI research team and contribute to shaping the evaluation standards for next-generation AI-generated video models. We are seeking experienced professionals from the film, theatre, animation, visual effects, and post-production industries who possess a strong understanding of professional video production and visual storytelling.
In this role, you will evaluate AI-generated videos by comparing multiple outputs created from the same prompt and determining which result demonstrates stronger professional execution. Your expertise in camera techniques, lighting, colour grading, composition, visual effects, editing, continuity, texture, acting, and dialogue delivery will help assess the quality and realism of AI-generated content.
You will provide clear, structured evaluations and professional feedback based on industry standards and practical production experience. This is an ongoing engagement, with opportunities to participate in additional evaluation rounds as new AI video models and capabilities are introduced.
Requirements
Key Responsibilities
- Compare pairs of AI-generated videos created from identical prompts and assess their quality across specific filmmaking and visual production parameters, including lighting, colour grading, framing, composition, camera movement, lens direction, texture, physical realism, shot continuity, acting, and dialogue delivery.
- Identify the stronger video based on professional production standards and demonstrate sound judgment across relevant creative and technical disciplines.
- Provide concise, specific explanations for evaluation decisions, highlighting successful elements, technical shortcomings, and areas where the output fails to meet professional expectations.
- Assess how accurately each generated video follows its original prompt, including the requested camera movements, lens choices, framing, visual composition, and performance requirements.
- Evaluate visual consistency, cinematic quality, character performance, editing choices, and overall production execution.
- Participate in calibration exercises with other evaluators to maintain consistency, reliability, and alignment across the evaluation process.
- Identify ambiguous evaluation criteria, unclear prompts, or guideline gaps and provide constructive recommendations for improvement.
- Collaborate with other subject matter experts to ensure the accuracy, consistency, and quality of video evaluation data.
Required Skills and Qualifications
- Professional or graduate-level experience in at least one relevant film, theatre, animation, visual effects, or post-production discipline, including:
- Film and Theatre, including current graduate students.
- Character Animation with a focus on human performance.
- Character Technical Direction.
- Acting Coaching, Training, or Teaching.
- Film and Video Directing, particularly crowd and background action.
- Assistant Directing.
- Visual Effects (VFX), Compositing, Lighting, Texture, and Surfacing.
- Render Management and Render Wrangling.
- Colour Grading and Digital Imaging, including Assistant Colourist or Digital Imaging Technician (DIT) roles.
- Camera Department experience, including First Assistant Camera (1st AC) or Camera Operator roles.
- Film and Video Editing.
- Display and Audio-Visual (AV) Quality Assurance.
- Either formal training from a recognised film, theatre, or animation institution combined with at least 2 years of practical industry experience, or a minimum of 4 years of hands-on professional experience, including involvement in at least two projects with a theatrical release.
- Strong understanding of professional filmmaking techniques, visual storytelling, production workflows, and creative execution.
- Excellent visual observation skills and the ability to identify subtle differences in lighting, framing, camera movement, continuity, texture, realism, and performance.
- Ability to communicate creative and technical judgments through clear, precise, and well-structured written feedback.
- Fluency in English, with strong written communication skills.
- Access to a high-quality display and headphones to accurately review visual details and dialogue quality.
- Ability to commit reliably to at least 20 hours per week on weekdays.
Preferred Qualifications:
- Professional proficiency in an additional dubbing language, particularly French, Italian, German, Spanish, Portuguese, Korean, or Hindi.
- Experience evaluating cinematic content, reviewing production footage, providing creative feedback, or working in quality control for film and video projects.
- Familiarity with professional production standards and the ability to assess both creative execution and technical quality.
Contract and Engagement Terms
- Engagement will be on an independent contractor basis.
- The position is fully remote, with flexibility to organise working hours around project requirements.
- A minimum commitment of 20 hours per week is expected, with reliable weekday availability.
- Project duration may be extended, shortened, or concluded earlier depending on business requirements and individual performance.
- Payments will be processed weekly through Stripe or Wise based on services rendered.
- The engagement will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
- Applicants must be legally authorised to work in their country of residence.
- H-1B and STEM OPT candidates cannot be supported for this engagement at present.