The work

You will propose machine learning engineering tasks intended to challenge frontier models over multiple attempts. Day to day, this means defining a technically precise task, explaining why it is difficult, and anticipating where a capable model will fail. The target is demanding: a strong task should succeed in no more than 2 of 8 attempts. The work leans toward inference, evaluation and systems rather than heavy model training, with roughly half of tasks running on GPUs and half on CPUs. You mainly contribute task plans and are not expected to build or review the completed tasks.

What the screen assesses

The platform screens for a current or recent role as an ML research engineer, research scientist or applied scientist, plus direct experience personally training, fine-tuning or optimizing models in PyTorch or JAX. Expect follow-up on at least one specialist area: LLM pretraining, alignment or evals; GPU inference and performance using vLLM, Triton, CUDA or profiling; reinforcement learning; or scientific ML in weather and climate, physics or biology. The screen is also likely to test whether you can distinguish a genuinely difficult, objectively evaluable task from one that is merely underspecified or laborious.

Practical details

Pay band: $150–200/hr

The listing does not specify remote status, asynchronous working arrangements, contract length or typical weekly hours. Candidates should be ready to state realistic availability and clarify scheduling expectations with Mercor. Benchmark-writing experience, a PhD in ML, CS or physics, an MSc with strong research output, publications and strong prior Mercor contract performance are preferences rather than stated requirements.