AI Conversation Evaluator

$40–70/hr

rate as listed

Workload: ~15h/week
Engagement: Project-based
Location: Worldwide
Field: Generalist

Compare AI assistants through natural, multi-turn conversations and record structured ratings plus brief written feedback. This is a remote, short-term contract for regular ChatGPT users who can participate during the stated project window.

The work

You will use a personal ChatGPT Free or Plus account to hold everyday, multi-turn conversations with different AI assistants. Scenarios may involve writing, trip planning, research, brainstorming or general questions. After each comparison, you will select the experience you preferred, rate qualities such as helpfulness, clarity and tone, and briefly document positive and negative moments.

What the screen assesses

The screening focuses on whether you actively use ChatGPT at least 3 times per week, can describe real use cases, and can distinguish between a response that is merely acceptable and one that creates a better overall conversation. Expect follow-up questions about specific examples, how you would apply rating criteria consistently, and how you recognize repetition, unnecessary content or unnatural behavior. No coding, previous AI evaluation experience or specific professional background is required.

Language and logistics

The role is remote and open globally. The listing labels English as required in its location summary, while later describing English proficiency as preferred. You need a computer or smartphone, an active personal ChatGPT account, and availability between November 15 and November 18; the stated kickoff is Sunday, November 15. The expected total commitment is approximately 7.5 hours, with flexibility during the project window rather than a continuing weekly schedule.

Pay band: $40–70/hr

What they look for

ChatGPT
AI agents
Attention to Detail
Following Instructions

Included with this listing

Interview prep — 10 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: This verifies the required usage frequency and account access while testing whether the candidate can cite genuine, recent interaction patterns.
A strong answer: State the Free or Plus account type, give a concrete usage frequency of at least 3 times per week, and name two or three recent tasks with enough detail to support follow-up questions.
Where people lose it: Claiming frequent use but offering only vague categories such as “research” or “work” makes the account activity difficult to verify.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.