Website:
remoexperts.com
Job details:
About The Role
Work from home generalist roles in India supporting AI/ML training pipelines. You will combine data labeling, RLHF evaluation, prompt evaluation, and QA evaluation across NLP, computer vision annotation, and content safety labeling while ensuring audit-ready, guideline-compliant outputs.
Key Responsibilities
- Perform NLP annotation (e.g., named entity recognition, text classification) and computer vision annotation (boxes, polygons, segmentation)
- Execute RLHF preference ranking to support large language model training
- Conduct prompt evaluation to identify instruction-following issues, hallucinations, and policy gaps
- Run QA sampling, audits, and checks to ensure annotation guidelines compliance
- Document edge cases, propose guideline clarifications, and report systematic errors
- Apply consistent content safety labels and moderation judgments
- Maintain throughput while protecting accuracy, consistency, and reviewability
Required Qualifications
- Mid-Senior experience in operations, analytics, or data-centric workflows
- Strong English reading comprehension and careful reasoning
- Ability to follow complex annotation guidelines and make consistent judgments
- Comfort with repetitive tasks, quality targets, and QA feedback loops
- Proficiency with web tools and spreadsheets; reliable internet for remote work
Preferred Qualifications
- Experience with RLHF, LLM evaluation, prompt evaluation, or content moderation
- Familiarity with NLP concepts and dataset QA
- Exposure to computer vision annotation workflows
Compensation
Competitive hourly pay:
$30–$50/hour (USD).
Remote, full-time role.
Click on Apply to know more.