Evaluation Specialist/Recent Grad

$20–60/hr

rate as listed

Workload: ~15h/week
Engagement: Project-based
Location: Worldwide
Field: Other

Create research-backed question-and-answer pairs that expose the limits of advanced AI models, then revise them based on model performance and reviewer feedback. This is remote contractor work suited to recent graduates and experienced researchers from any academic or professional background.

The work

You will develop original, multi-step questions across varied subjects, research authoritative answers and document the reasoning with clear citations. Day to day, that means triangulating multiple sources, testing questions against AI models, examining how the models succeed or fail and adjusting difficulty without introducing ambiguity.

What the platform screens for

The screen is likely to focus on concrete examples of independent research, precise writing and judgments about source quality. You should be prepared to explain how you reconcile conflicting evidence, construct an answer key, distinguish genuine reasoning from lookup and respond to reviewer feedback. English fluency is required, but it does not need to be your first language. Prior AI training, evaluation or content-creation experience is a plus, not a requirement, and no particular academic field is specified.

Contract and schedule

This is remote contractor work performed independently. Compensation is output-based and limited to tasks that meet project specifications, so the time spent on a task may vary and the observed band is not guaranteed.

Pay band: $20–60/hr

No fixed daily schedule or typical weekly hours are disclosed. Minimum submission requirements apply, including a weekly task minimum whose number is not stated. The platform says selected candidates should be ready to begin their first tasks within 24–48 hours after onboarding.

What they look for

Research & source triangulation
Attention to detail
Written precision
Self-direction & reliability
Analytical thinking

Included with this listing

Interview prep — 10 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: This tests whether you can describe a verifiable research workflow, identify the sources actually used and explain what triangulation changed about the conclusion.
A strong answer: Use one specific academic or professional example, naming the source types, the claim each source supported and how you resolved gaps or inconsistencies. Include a concrete output such as a paper, report, dataset or documented recommendation.
Where people lose it: Candidates lose points by calling a collection of search results “triangulation” without showing that the sources were independent, authoritative or compared claim by claim.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.