What the work involves

You design short conversations — usually one to five turns — that force the model to reach into your actual personal context, then judge whether it did so well. That means checking Grounding (is the claim about you supported by a real data source, or is it a flawed inference or hallucination?), Integration (is the personal detail woven in naturally, or does the model overnarrate — "Since you watched three videos about sourdough last week..."), and overall Helpfulness. Most tasks end in a side-by-side stack ranking of two responses plus a written rationale in which you cite specific turn numbers and quote the offending text.

Two parts of the job are easy to underestimate. First, you pull and verify "Debug Info" to confirm which data sources and chat summaries the model actually used — so your grounding calls rest on evidence, not impression. Second, data hygiene: you delete evaluation conversations so they don't contaminate your own future chat history and skew later personalization.

What the platform screens for

Turing's screen is a Job Interest Form, then a profile review, then a timed assessment that must be returned within 24 hours. Expect the assessment to look like the real task: read a personalized exchange, rank two candidate responses, and defend the ranking in writing. Screeners weight three things heavily — whether your written Portuguese is fluent and register-appropriate for Portugal, whether your rationales point at specific turns rather than gesturing at overall vibe, and whether you can name the failure modes (wrong personalization, forced connection, over-narration) as distinct problems rather than one undifferentiated "bad answer."

There is also a non-negotiable consent question. The project needs genuine personal signal, so you must be willing to use your primary personal Google account with Gmail, Search, and YouTube history enabled — not a clean test account. If that is a dealbreaker, it is better to say so at the form stage than after onboarding.

Logistics

  • Remote, contractor engagement, roughly 3 months.
  • Minimum 4 hours per day, up to 40 hours per week.
  • Requires about 4 hours of daily overlap with PST — from Portugal that generally means late afternoon into the evening.
  • Desktop or laptop plus reliable broadband; this is not phone-compatible work.
  • Observed rate is $15/hour as stated by the platform; rates are not guaranteed and can vary by project stage.