About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written German text, annotated and corrected by humans.

Responsibilities:

• Respond to a set of prompts simulating realistic business or casual communication.
• Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
• Generate responses with intentional but realistic grammar, spelling, and structural errors.
• Review annotated message pairs (input text + corrected/proofread version) to ensure:
• All grammar/spelling/preposition/punctuation errors are corrected appropriately
• Meaning is preserved between input and corrected text
• Error types are classified correctly
• Explanations are clear and linguistically sound

Qualifications:

• German as a first language - C1 German proficiency 
• English as a second language - B2 English proficiency.
• Ability to follow linguistic and situational writing prompts.
• Good written communication and creativity.
• 2 years working experience in a corporate/ business environment.
• 1 year working experience working as an AI Evaluator, data annotator, or similar role 
• Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.
• Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.
• Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.
• Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
• Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment. Access to your own laptop for work 

Preferred Qualifications:

• C1 or C2 English preferred 
• Experience working with NLP/GenAI models is a plus 

NB: This is a temporary, project-based position with the possibility of renewal. While this role will be on payroll, please note that benefits are not included as part of this position.

About the Job:

We invite you to join our talent pool as an AI Evaluator, where you will contribute to the advancement of cutting-edge Natural Language Processing (NLP) models. In this role, you will ensure the high quality of AI-generated writing and create original content that enhances the AI’s capabilities. Your insights into client needs and best practices will be instrumental in driving our success and shaping the future of AI-driven content.

Why This Role is Open: As our AI solutions continue to grow and evolve, we are seeking skilled AI Evaluators to help us fine-tune, review, and improve the performance of our models. This is an evergreen position, meaning we are continuously seeking talented individuals for this role. We accept applications on an ongoing basis because we frequently have openings as we expand. If you’re passionate about AI and are looking for a dynamic opportunity, we encourage you to apply now, even if there is no immediate opening.

What to Expect: By joining our AI Evaluator Talent Pool, you’ll be among the first to be considered when positions open up. We are actively reviewing candidates and expect to invite selected individuals for an assessment within the next few weeks. Once assessed, you'll be kept informed of any openings and have a priority spot in the hiring process when roles become available.

Key Responsibilities: 

• Write detailed top-tier original content that demonstrates great creativity and an excellent grasp of English grammar and comprehension.
• Evaluate, edit, and improve the quality of AI-generated writing as well as that from humans-in-the-loop.
• Rate the quality of AI-generated content on rubrics such as grammar, brevity, and correctness.
• Be a thought partner to Delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
• Deliver just-in-time coaching/mentorship support to production teams on new or changing project instructions as well as “refreshers” on existing instructions on an as-needed basis.
• Manage investigations of escalations to understand the root cause(s), work through the remediation actions, and champion the recovery process.
• Manage the performance and quality of your team through coaching and mentoring to improve writing quality.
• Be a master of the Sama platform.

Minimum Qualifications:

• Have completed a Bachelor's degree or higher in English or Literature.
• Fluency in English at C1/C2 level. Excellent English grammar and comprehension.
• A critical eye and the ability to clearly explain the strengths and weaknesses of a given piece of text.
• Excellent sense of writing style.

Preferred Qualifications:

• At least 2 years of experience in a creative writing role.
• Experience working with NLP/GenAI models is an added advantage.
• Strong critical thinking, reasoning, and exceptional problem-solving skills.
• Excellent written and oral communication skills.
• Demonstrable ability to perform well in a rapidly changing and extremely global team.
• Excellent attention to details.
• Passion for our mission of ensuring a world-class support experience for our community and customers.
• Experience as an editor is an added advantage.

Application Process:

Once you’re part of our talent pool, here’s what you can expect during the interview process:

1. After submitting your application, if you're shortlisted, we’ll invite you to a 60-minute in-person/ virtual assessment. 
2. If you pass the assessment, we’ll let you know via email.
3. Once a project is ready to go live, those who’ve passed will be invited to training (this can happen anywhere from a few days to a few weeks after the assessment, depending on the project timeline).
4. Kindly note that a valid Police Clearance Certificate (Certificate of Good Conduct) is a mandatory requirement for consideration into training.

We’ll provide helpful feedback along the way so you know where you stand and feel supported throughout the entire process.