What the work actually is

You are not advising a client. You are constructing the problems a model is graded against — and then writing the answer a model should have given. In practice that means authoring prompts drawn from real practice (a poorly drafted indemnity, a regulatory notice with ambiguous scope, a contract clause that reads fine until you check the defined terms), producing a reference solution that survives scrutiny, and documenting why competing answers are wrong. The second half of the role is calibration: reading other senior lawyers' tasks and solutions, flagging where a rubric is underspecified, and escalating genuine ambiguity rather than silently resolving it your own way.

Difficulty is the point. Tasks that a competent model already answers correctly have little training value, so you will be pushed to find the places where legal reasoning actually forks — jurisdictional variation, conflicting authority, facts that change the analysis on second reading. Expect to be asked to justify why a task is hard, not merely that it is.

What the screen looks for

  • Verifiable practice history. 5–15 years, ideally Senior Associate, Counsel, or in-house equivalent. Expect questions about the transactions and matters you personally ran.
  • Bar admission or equivalent qualification in your region, active.
  • Drafting depth — negotiating and revising commercial agreements, policies, and regulatory-facing documents, not just reviewing them.
  • Judgment under follow-up. Screeners push a second and third time on the same answer to see whether your reasoning holds or you retreat to generalities.
  • Willingness to say a model output is wrong and name the specific error rather than grading on tone and confidence.

Prior AI evaluation or annotation experience is welcome but explicitly not required; legal depth carries the decision.

Logistics

Fully remote contractor engagement of up to 8 weeks, with possible extension at the platform's discretion. Minimum four hours per day, up to 40 hours per week, and four of those hours must overlap Pacific time — this is a real constraint, since calibration and escalation happen synchronously with the Functional SME Lead. Pay is not disclosed in the listing; Turing typically sets hourly rates by seniority and region at offer stage. Shortlisted candidates receive a Job Interest Form before any offer conversation.