The work
You will design realistic software engineering tasks for advanced AI systems, including clear instructions, reproducible environments, reference solutions, tests, and objective evaluation criteria. Day to day, you may inspect model-generated code, reproduce failures, debug dependencies, test edge cases, and determine whether a submission is correct, robust, complete, and reproducible.
What micro1 screens for
The AI interview includes technical and integrity checks. Expect follow-up on prior paid AI-training or model-evaluation work, specific repositories or technical artifacts, and decisions you made when grading code. Python is required. Professional experience with at least one additional programming language is also required, with Java, JavaScript, TypeScript, Rust, C++, C#, and Go listed as examples. Experience with benchmark construction, graders, Linux, Docker, CI/CD, command-line tools, sandboxed environments, programming competitions, or long-horizon and agentic coding evaluations is preferred rather than required.
Logistics
This is a global, fully remote contractor role with a flexible schedule and a commitment of at least 15 hours per week. Work is task-based and largely asynchronous, although the listing does not specify meeting expectations. Compensation is output-based and depends on tasks meeting project specifications and quality requirements, so task availability and completion time may vary.
Pay band: $60–120/hr
