The work
Contractors turn situations from their own machine learning research into rigorous evaluation problems. Day-to-day work includes defining an experimental question, specifying controls and ablations, interpreting model behavior, producing a reference answer with step-by-step reasoning, and identifying methodological errors that may appear plausible to a non-practitioner.
What afterquery screens for
The screening focuses on verifiable research experience, including at least three years of full-time ML research after your degree, hands-on experimental work, and the ability to reason precisely about evaluation design and failure analysis. Strong Python and experience with a deep learning framework such as PyTorch or JAX are required. Publications at venues such as NeurIPS, ICML, ICLR, ACL or CVPR, and experience in an industry research lab or university research group, are preferred. Clear written English is also preferred.
Working arrangement
The work is fully remote and asynchronous, with no fixed schedule. You must be able to commit at least 10 hours per week, while setting your own hours and scaling your workload up or down from week to week. Payments are made weekly via Stripe.
Pay band: $115/hr
