What the work involves

This is personalization evaluation, which means the data is yours. You connect your own Google apps to Gemini, receive or generate prompts that require pulling real context from your mail, calendar, files and photos, and then judge what comes back. A typical task is either a single-response rating against project rubrics or a side-by-side comparison where you pick the better answer and justify the call. Much of the judgment sits in the gap between a response that sounds personalized and one that is actually grounded — did it cite the right thread, invent a meeting that never happened, or confidently summarize a document it never opened? You log those failure modes in written feedback that a research team downstream can act on.

What the screen is looking for

Three things dominate. First, genuine account depth: an account with two years of real mail, recurring calendar events and a populated Drive produces useful retrieval prompts; a fresh or barely-used account does not, and this is checked. Second, willingness to grant the app integration permissions and sign the consent forms and NDA — there is no version of this project where you rate personalization without connecting personal data, so hesitancy here ends the process. Third, whether your written reasoning distinguishes a factual retrieval error from a tone or usefulness preference. Prior annotation, QA or content-review experience helps but is explicitly not required; a bachelor's degree or equivalent practical experience in any field is the stated baseline.

Logistics

  • Fully remote, US-based only — location is a hard gate.
  • Contractor engagement, up to 16 weeks.
  • At least 4 hours per day, up to 40 hours per week, with 4 hours overlapping Pacific time.
  • Desktop or laptop and a reliable connection; phone-only setups will not work.
  • Pay is undisclosed on this listing. Turing generalist rating work is commonly observed in the hourly range typical of US evaluation contracts, but nothing here is guaranteed — ask for the rate in writing before onboarding.

Shortlisted candidates receive a Job Interest Form, then consent and onboarding steps if selected.