AI Product Evaluator

$14–36/hr

rate as listed

Workload: ~15h/week
Engagement: Project-based
Location: IN, JP, GB
Field: Generalist

Evaluate AI models and agents against defined scenarios, then document errors, behaviors, and anomalies in structured reports. This remote contractor role is open to candidates in India, Japan, or the United Kingdom and involves precise, sometimes repetitive work under strict timeframes.

The work

You would run pre-defined scenarios against AI models and agents, assess accuracy, reasoning, responsiveness, and instruction-following, and record the results on AI training platforms. Day-to-day work may include repeating tests after usage-limit resets, documenting anomalies, and preparing evaluation datasets that meet project standards and milestones.

What the screening is likely to examine

micro1 is looking for evidence that you can interpret complex evaluation instructions, execute them consistently, and distinguish a genuine model failure from an ambiguous prompt or testing artifact. Experience evaluating AI products, models, or agents is preferred. Prior work in digital products, software QA, or AI research is a plus, and the listing also prioritises people who already use AI in daily life.

Working conditions

This is a remote contractor engagement for candidates located in India, Japan, or the United Kingdom. The work is operationally intensive and may be repetitive or high-volume, with strict timeframes and protocols tied to usage-limit resets. The listing does not specify whether scheduling is fully asynchronous or state typical weekly hours.

Compensation

Pay band: $14–36/hr

What they look for

AI Models
AI Agents
Following Instructions
Attention to Detail

Included with this listing

Interview prep — 10 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: This tests whether your claimed AI evaluation experience includes a real system, defined test dimensions, and observable outcomes rather than casual model use.
A strong answer: Name the system and project context, describe the scenarios or rubric, and explain what evidence you captured. Include at least one concrete finding and what happened after it was reported.
Where people lose it: Describing regular chatbot use as evaluation without identifying test criteria, repeatable steps, or documented results.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.