Audio Generalist Evaluator Expert
Mercor
- Experience
- 0+ yrs
- Location
- remote
- Job type
- Full-time
About the role
For this assessment, you will listen to audio samples, evaluate model responses, critique rubric criteria, and draft your own criteria. The assessment contains 3 parts:
(1) Critique of the model's response (2) Critique of rubric criteria (3) Draft of your own criteria
This assessment does not aim to evaluate your expertise in audio or linguistics, but rather your ability to identify shortcomings, omissions, and/or faults in a prompt/rubric. Please review the candidate guide document before attempting the task.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.