This role is for one of our clients

We are seeking detail-oriented and analytical Business Analysts – Non-US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, applying predefined evaluation criteria, conducting structured assessments, and delivering accurate, well-documented judgments.

Candidates should have strong analytical skills, business analysis experience, attention to detail, and the ability to work independently in a remote, fast-paced environment. This opportunity is suitable for professionals interested in contributing to AI evaluation and improving the quality, relevance, and reliability of AI-generated responses.

Job Details

• Role: Business Analyst – Non-US Raters
• Experience: 3+ years
• Employment Type: Short-term contract
• Contract Duration: 16 weeks
• Location: Argentina, Peru, Mexico, Brazil, Chile, Colombia, India, and Pakistan
• Compensation: USD 15 per hour
• Start Date: Immediate
• Work Mode: Fully remote
• Availability: Full-time commitment of 8 hours per day
• Time Zone Requirement: Minimum 4 hours of overlap with the US Pacific Time (PST) time zone
• Work Schedule: Five working days per week, including weekends when required, with two weekdays off

Requirements

Key Responsibilities

• Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria.
• Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses.
• Analyze business requirements and translate them into clear evaluation guidelines and functional specifications.
• Gather, interpret, and document relevant information to support consistent and objective assessments.
• Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement.
• Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy.
• Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions.
• Track task progress, quality metrics, and project deliverables while meeting established deadlines.
• Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework.
• Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process.

Required Qualifications and Skills

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
• At least 3 years of experience as a Business Analyst or in a similar analytical role.
• Strong analytical thinking, problem-solving, and decision-making abilities.
• Excellent written communication skills and the ability to explain findings clearly.
• Strong attention to detail and the ability to assess information objectively.
• Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools.
• Experience with requirement gathering, process mapping, and business documentation.
• Ability to work independently, manage multiple priorities, and meet strict deadlines.
• Strong documentation skills and the ability to follow structured evaluation guidelines.
• Familiarity with Agile or Scrum methodologies is an advantage.
• Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap.

Engagement Benefits

• Opportunity to contribute to projects focused on AI evaluation and response quality.
• Fully remote work arrangement with the flexibility of working from your location.
• Exposure to structured AI assessment workflows and quality evaluation processes.
• Opportunity to contribute to projects with international reach.
• Clearly defined contract duration, hourly compensation, and evaluation responsibilities.

Important Engagement Details

• This is a project-based contract lasting 16 weeks.
• Work will consist of evaluating multiple chatbot responses and submitting a final assessment for each assigned task.
• Candidates must be available for 8 hours per day, five days per week, with four hours of overlap with US Pacific Time.
• The schedule may include weekend work, with two weekdays off each week.
• Candidates are expected to maintain consistent evaluation quality, follow project guidelines, and complete assigned tasks within the required timelines.