Humanities Expert - AI Training Data Reviewer

Role Overview

We are looking for Humanities Experts to join our team and contribute their subject-matter expertise to the development and evaluation of high-quality AI systems.

In this role, you will review questions and answers across a range of humanities topics, applying your academic knowledge, critical thinking, and attention to detail to assess the quality of AI-generated content.

You will play an important role in helping ensure that AI systems produce responses that are accurate, relevant, coherent, well-reasoned, and aligned with high-quality standards.

Requirements

• +5 years of experience
• Bachelor's degree or equivalent professional or academic expertise in a Humanities-related field, such as:

-History
-Philosophy
-Literature
-Linguistics
-Languages
-Cultural Studies
-Sociology
-Anthropology
-Political Science
-Religious Studies
-Arts & Humanities
-Or a related discipline

• Strong subject-matter knowledge and the ability to engage with a broad range of humanities topics.
• Excellent critical thinking, analytical reasoning, and written communication skills.
• Strong attention to detail and ability to identify subtle factual or logical issues.
• Ability to objectively assess the quality of written content and distinguish between strong and weak answers.
• Familiarity with AI training, data annotation, evaluation, or related AI data workflows.
• Ability to follow detailed guidelines and apply evaluation criteria consistently.
• Strong English proficiency, both written and reading.
• Ability to work independently and manage responsibilities in a remote environment.

Responsibilities

• Review and evaluate questions and answers related to humanities disciplines.
• Assess content for factual accuracy, relevance, clarity, completeness, and logical consistency.
• Identify inaccuracies, misleading statements, gaps in reasoning, ambiguities, and other quality issues.
• Apply subject-matter expertise to evaluate nuanced or complex topics.
• Judge whether responses appropriately address the question and fulfill the expected requirements.
• Provide clear and consistent evaluations based on established quality guidelines.
• Navigate topics across different areas of the humanities while maintaining strong analytical standards.
• Apply best practices in AI training data generation, annotation, and evaluation.
• Contribute to improving the quality and reliability of datasets used to train and evaluate AI models.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.

Offer Details:

• Commitments Required: 40 hours per week with 4 hours of overlap with PST.
• Engagement type: Contractor
• Engagement Length:  4 weeks

Evaluation Process -

• Shortlisted candidates will be sent a Job Interest Form.
• Final selected candidates will be contacted with the next steps and onboarding requirements.