Flag job

Report

AI Agent Assistant Evaluators - LLM Annotation & QA [AS‑L]

Salary

$12k

Min Experience

1 years

Location

Bangladesh, India, Indonesia, Malaysia, Pakistan, Philippines, Sri Lanka, Thailand, Vietnam

JobType

freelance

About the job

Info This job is sourced from a job board

About the role

Applicants should bring at least one year of professional or academic experience in data annotation, strong familiarity with multiple LLMs, and solid English skills at B2 or above. Curiosity, intellectual breadth, and meticulous attention to detail are essential, along with competence in web research, fact‑checking, and prompt crafting. Final‑year university students and graduates from diverse disciplines are welcome if they meet these criteria. All candidates must be ready to complete a short six‑question qualification test, verify their identity, and join the project Discord workspace. The work centers on evaluating and improving AI assistant conversations: you will fact‑check model outputs, verify user intent alignment, flag inaccuracies, and supply clear feedback or refined prompts to enhance LLM performance. Tasks are delivered remotely, can be done on your own schedule, and are compensated at a fixed rate of $8 per hour.

Skills

data annotation
llm
english