The work
You will review two AI-generated responses to the same medical prompt, inspect the reasoning provided in the input files, and decide which response is stronger. Each judgment requires a clear written explanation grounded in clinical accuracy, patient safety, current guidelines, evidence quality, and realistic medical decision-making.
What Mercor screens for
The screening is likely to test whether you can substantiate your clinical or biomedical background, identify subtle reasoning and safety failures, and defend a preference between two imperfect answers. Strong candidates can distinguish a clinically meaningful error from a stylistic weakness, handle uncertainty, and explain how current evidence or guidelines affect an evaluation.
Practical details
The expected workload is 10–20 hours per week, with onboarding and specialty calibration sessions included. The role starts immediately, and applications are reviewed on a rolling basis. The listing does not specify whether the work is remote or fully asynchronous.
Pay band: $150/hr
