What the work actually involves
You take a public C++ repository — typically something with real build complexity, not a toy — and turn a piece of its history into a verifiable task. That means reading an issue and its linked commits, reconstructing the pre-fix state, getting the project to build and its tests to run reproducibly inside Docker, and then deciding whether the existing tests are a sound oracle for the fix. In C++ this is rarely trivial: CMake or Bazel configurations, third-party dependency pinning, compiler and standard-library version drift, and flaky or timing-dependent tests all get in the way, and resolving them is the job rather than a distraction from it.
The second half of the work is judgment. Researchers want tasks that are hard for models in an interesting way — not tasks that are hard because a header is missing or a build flag is undocumented. You will be asked to say why a given issue is or isn't a good candidate, to spot when a test would pass on a wrong patch, and to flag when the issue text leaks the solution. Some contributors also lead small groups of junior engineers doing the same pipeline work.
What the screen looks for
- Two rounds, roughly 75 minutes total: a 60-minute technical interview and a 30-minute technical-and-cultural conversation.
- Depth of real C++ experience under follow-up — build systems, debugging native code, test frameworks (GoogleTest, Catch2), sanitizers.
- Whether you have genuinely worked inside large unfamiliar codebases rather than only greenfield projects.
- Evaluation instinct: can you tell a weak test suite from a strong one, and articulate why.
Logistics
Fully remote contractor assignment — no medical or paid leave. Commitment options are 20, 30 or 40 hours per week, with a minimum of 4 hours per day and at least 4 hours of overlap with PST. Hiring is restricted to India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey and Mexico. Pay is not disclosed on this listing; Turing's C++ evaluation engagements are typically hourly and rate varies with experience and weekly commitment — treat any figure you hear secondhand as unverified.