The work

You listen to pairs and batches of AI-generated music and decide which output is better — and articulate why in language an engineering team can act on. Sessions mix comparative rating (musicality, creativity, prompt adherence, vocal quality, production and mix quality) with structured annotation: genre and sub-genre tagging, song-structure segmentation, and vocal/instrumental characteristics against a fixed taxonomy. A significant share of the work is Japanese-specific: judging whether generated lyrics scan naturally, whether pitch-accent and mora timing sit correctly against the melody, and whether vocal synthesis produces convincing Japanese phonemes rather than accented approximations.

Expect written rationales alongside every score. The lab consuming this data cares less about your rating than about the reasoning behind it, so evaluators who can name the specific artifact — a smeared transient, a pumping bus compressor, a sibilance problem in the vocal chain, a chord substitution that breaks the genre convention — are the ones who stay on projects.

What the screen looks for

  • Verifiable production credits: three or more years as a producer, audio engineer, or mixer, with releases or sessions you can describe in detail.
  • Fluent audio-engineering vocabulary used correctly under follow-up, not recited.
  • Demonstrated Japanese songwriting or lyric-writing experience, plus enough English to follow written rubrics and instructions.
  • Consistency — the ability to apply the same standard across a long session without drifting.

A music degree covering performance, theory, and lyric writing strengthens an application but does not substitute for professional studio work.

Logistics

Fully remote and asynchronous, with work claimed from a queue. Part-time at 10+ hours per week, projected to run up to six months, immediate start. Observed pay on this listing runs $34.72–62.49/hr, banded by demonstrated depth and assessed skill — treat that as a range others have reported, not a guarantee. Onboarding is a resume upload plus a 25-minute conversational AI interview, with next steps typically within a few days. You will need decent monitoring: reference headphones or monitors, and a quiet listening environment.