What the work involves

You'll listen to pairs or batches of AI-generated music samples and decide which is better — and, more importantly, articulate why in language an engineering team can act on. That means separating a weak arrangement from a weak mix, noticing when a vocal model produces a phonetically wrong French vowel or misplaces a syllable against the beat, and flagging when generated lyrics are grammatical but idiomatically dead. Alongside comparative scoring, you'll annotate tracks against a structured taxonomy: genre and sub-genre, song structure, instrumentation, vocal timbre and technique, and production characteristics. Some tasks involve rating the quality of training data rather than model output.

The French component is not incidental. The lab needs raters who can hear whether a generated vocal sounds like a French speaker singing French, catch prosody errors that an English-first listener would miss, and judge whether lyrics land in the register the prompt asked for — chanson, rap, variété, or something else. Task instructions and rubrics arrive in English, so you need to work comfortably in both.

What the platform screens for

Mercor runs a roughly 25-minute AI-led conversational interview after resume upload. Expect it to probe your production or engineering credits with follow-ups — which rooms, which DAWs, which credits are verifiable, what your actual role was on a given release. Vague claims tend to collapse under a second question. The screen also tests whether you can describe audio problems in precise terms (masking, sibilance, pumping, phase issues) rather than adjectives, and whether you can hold a consistent standard across many samples instead of drifting toward personal taste.

Logistics

  • Fully remote and asynchronous; you set your own hours within task deadlines
  • 10+ hours per week, part-time, up to a six-month engagement
  • Immediate start; onboarding details typically follow within a few days of the interview
  • Observed pay band is $30–60.48/hr — placement within it reflects credentials and project tier, and is not guaranteed
  • You'll want decent monitoring: reliable headphones or monitors, and a quiet listening environment