Web Research Specialist - LLM Evaluation

Employment Type: Contractor

Start Date: Immediately

Engagement Length: 8 weeks

Years of Experience: 3+ years of experience

Commitment Required: Full-time. 40 hours per week with at least 4 hours PST overlap

Pay Rate: (Average Handling Time per Task: 3 hours) Pay per task, $30/task, effective ~$10/hr

About the Client

Our client is one of the worlds fastest-growing AI companies, accelerating the advancement

and deployment of powerful AI systems.

It helps customers in two ways: Working with the worlds leading AI labs to advance frontier

model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality,

STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve

mission-critical priorities for companies.

About the Role

We are building an evaluation benchmark for frontier AI browsing agents. Your job is to design

research problems that a state-of-the-art AI cannot solve, even with full web access and multiple

attempts. This is not a subject matter expert role, nor is it a content-writing role. It is

investigative research.

You will start from a verifiable fact, work backwards to construct a question that makes that fact

extremely hard to locate, and then prove your work with a complete, auditable evidence trail.

What You Will Produce

• A natural-language research question with a short, stable, objectively verifiable answer
• Clues, each independently checkable, spanning multiple fact types - including dates,

people, places, organisations, works, events, records, and quantities - with specific

constraints

• A validation record showing the obvious searches you ran and the results they

returned

Minimum Qualifications

• Demonstrated open-web research ability, including locating primary records and

navigating government and institutional databases, archives, registries, and PDF

documents

• Precision with sourcing. You cite exact pages, tables, and sectionsnot just

homepages

• Comfort researching unfamiliar subjects from scratch
• Native or near-native written English
• High tolerance for structured documentation. The evidence trail is the majority of the

work

• Experience with LLM evaluation, red-teaming, or benchmark construction
• Experience in one or more of the following domains:

1. Reference librarianship, archival research, or special collections

2. Investigative journalism or professional fact-checking

3. OSINT, due diligence, KYC, or investigative research

4. Patent, prior-art, or legal-discovery search

5. Genealogy and records research

6. Competitive quizzing or puzzle-hunt construction

Nice to Have

• Experience with LLM evaluation, red-teaming, or benchmark construction
• Familiarity with JSON and structured data delivery formats