The work

You will compare pairs of AI-generated responses to in-house legal tasks, select the stronger response and explain the decision using source documents and applicable US law. Assignments may cover contract review, policy and compliance questions, employment matters, disputes, risk assessments and business-facing legal advice. You will also identify omissions or unsafe recommendations and create realistic prompts, fact patterns and model answers based on in-house practice.

Screening

The platform will look for an active bar membership, a J.D. from an ABA-accredited law school and at least three years of legal practice that includes advising a business in-house. Expect follow-up questions about specific matters, how you distinguish legal accuracy from practical usefulness, and how you evaluate two plausible but imperfect answers. AmLaw 100 experience and prior legal AI, annotation or benchmark work are preferred but not required.

Engagement logistics

The role starts immediately, with applications reviewed on a rolling basis. Work is expected to recur as projects launch, but the listing does not promise a continuous workload. Onboarding and calibration sessions are part of the engagement. The listing does not specify whether work is remote or asynchronous, or provide typical weekly hours.

Pay

Pay band: $100–120/hr