Computer Science Research Annotator

About the Role:

This role involves deep technical reading of ML, AI, systems, and security research, evaluating claims, verifying reasoning steps, and identifying inconsistencies in academic or technical content. You will review research papers, analyze code snippets, and ensure factual and logical accuracy across complex CS research domains.

Responsibilities:

• Read and interpret ML/AI, systems, and security research papers.
• Validate technical claims, algorithmic steps, and formal reasoning.
• Classify hallucinations and detect inconsistencies in research arguments.
• Review and verify code snippets or pseudocode.
• Evaluate evidence alignment and correctness of methodology.
• Annotate errors, ambiguities, and unsupported claims.
• Collaborate with QA leads to maintain annotation quality standards.

Skills & Experience Required:

• MS/PhD in Computer Science OR 25 years research/industry experience.
• Strong fundamentals in machine learning, deep learning, systems, or security.
• Experience reading academic papers (NeurIPS, ICML, ICLR, USENIX, etc.)
• Ability to evaluate research methodology, assumptions, and proofs.
• Familiarity with code review and logic debugging.
• Excellent analytical skills and attention to detail.
• able to parse research papers, verify reasoning, and catch subtle inconsistencies.