Domain Expert Politics

Role Overview:

We are seeking a highly qualified Politics Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within political science, governance, elections, public policy, international relations.

Key Responsibilities

•  Create advanced prompts covering political science, governance, elections, public policy and international relations.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and documentation.

Minimum Qualifications

• Master's degree or higher in any field; degrees in Political Science, Public Policy, International Relations, Government, Public Administration, Law, Economics, Journalism, or other politics-related disciplines are preferred.
• Strong knowledge of politics, including political systems, governance, elections, public policy, international relations, political institutions, comparative politics, and current global political developments.
• 3+ years of relevant professional experience, preferably in public policy, government, political research, political consulting, academia, journalism, international affairs, think tanks, or a related field.
• Excellent written English, research, and analytical skills.
• Strong attention to detail and ability to evaluate political information accurately, identify factual inconsistencies, and assess reasoning across a wide range of political and public policy topics.

Preferred Qualifications

• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and provide objective, evidence-backed reviews.

Offer Details:

• Commitments Required: 40 hours per week with at least 4 hours PST overlap
• Employment type  : Contractor assignment (no medical/paid leave)
• Duration of contract : 8 weeks.
  

Application Process

• Complete the assessment shared with you.
• Our team will evaluate your submission.
• Selected candidates will be contacted regarding the next steps.