What the work involves

You sit a layer above the people writing the data. Pod Leaders and their contributors generate high-difficulty legal tasks — the kind a model should struggle with — along with reference answers, rubrics, and evaluations of model output. Your job is to make sure what leaves the pod is legally correct, reasoned in a way a practitioner would recognise, and calibrated to a difficulty that actually stresses the model rather than testing recall of black-letter basics.

Day to day that means: reviewing samples of task output for substantive accuracy and rubric quality, adjudicating disagreements where two qualified lawyers reach different conclusions, spotting jurisdictional sloppiness (a clause reasoned under English law and graded under New York law), and coaching Pod Leaders on why a rejection was a rejection. You will also be pushing back on tasks that are ambiguous, unanswerable, or hinge on facts the prompt never supplied.

What the screen looks for

  • Verifiable seniority. Bar admission (or regional equivalent, active) and a practice history at Senior Associate, Counsel, or above. Expect follow-ups on the actual matter types you handled, not job titles.
  • Depth under probing. Contract drafting, legal analysis, and regulatory interpretation get tested with concrete hypotheticals. Vague answers get one follow-up, then a lower score.
  • Evaluation judgment. Can you articulate why one legal answer is better than another in terms a rubric can carry? Can you distinguish a wrong answer from a defensible minority position?
  • Management evidence. Reviewing, mentoring, or quality-assuring other lawyers' work — with specifics on how you handled a disagreement or a persistent quality problem.

Logistics

Contract engagement, six weeks with possible extension, starting as soon as possible. Work is remote and largely asynchronous, but the team runs on PST and lead roles carry live overlap for reviews, escalations, and Pod Leader check-ins — clarify the expected overlap window in the screen rather than assuming full flexibility. Pay is undisclosed on this listing; ask for the rate and the weekly hour commitment before signing, as both have varied across Turing's lead-tier legal engagements.