Intelligence Analyst

$30–80/hr

rate as listed

Workload: ~15h/week
Engagement: Project-based
Location: Worldwide
Field: Other

Evaluate AI-generated intelligence analysis for source handling, analytic rigor, uncertainty, limitations and practical utility. The work also includes designing test cases, mapping scenarios to taxonomies and documenting edge cases or over-refusals.

The work

This remote contractor role applies intelligence tradecraft to AI evaluation. Day to day, analysts develop realistic analytic cases, map them to defined taxonomies, write complex tests and grade model responses for reasoning quality, source use, uncertainty expression, recognition of limitations and practical utility.

Evaluation judgment

A central task is distinguishing appropriate safety boundaries from cases where a model over-refuses legitimate analytic exploration. Analysts document these decisions, surface disagreements and edge cases, and work with project leads to refine source-evaluation procedures, confidence-level assignments and benchmark standards.

What the platform screens for

The screen is likely to emphasize verifiable all-source experience or deep expertise in a specific analytic discipline, command of source evaluation and confidence language, familiarity with structured analytic techniques, and the ability to defend grading decisions under follow-up. Teaching, mentoring, analytic-review leadership and prior AI evaluation experience are preferred, while prior AI experience is not required.

Logistics

The engagement is remote and structured as contractor work. The listing does not state whether work is fully asynchronous or specify typical weekly hours, scheduling expectations or project duration.

Pay band: $30–80/hr

What they look for

Analytic rigor
Source handling
Over-refusal detection
All-Source Intelligence Analysis

Included with this listing

Interview prep — 10 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: This tests whether the candidate can substantiate relevant all-source work or discipline-specific depth with concrete responsibilities, products and decision contexts.
A strong answer: Give a concise career outline anchored in specific analytic assignments, the kinds of sources used, the audiences served and your individual responsibility for judgments. Where details are sensitive, describe methods and scope without disclosing protected information.
Where people lose it: Candidates lose points by relying on titles, mission language or unexplained acronyms without establishing what analysis they personally performed.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.