MyRemoteTeam, Inc
Website:
myremoteteam.com
Job details:
We’re Hiring: Bengali + Hindi Language Experts for AI Evaluation (Remote | India)
We are hiring language experts for AI Query Vetting and Evaluation workflows. This role involves working on real-world AI systems used by global enterprises, ensuring responses meet high standards of quality, accuracy, and safety.
Project Details
- Work on AI query vetting and response evaluation tasks
- Evaluate real user queries without changing intent
- Assess AI-generated responses for:
- Helpfulness & Quality
- Factual Accuracy
- Safety & Sensitivity
- Perform PASS/FAIL evaluations with structured reasoning
- Conduct Side-by-Side (SxS) comparisons across AI platforms
- Identify hallucinations and factual inconsistencies
- Maintain evaluation sheets and documentation
Requirements
- Proficiency in Bengali and Hindi (both written and spoken)
- Master’s degree in Linguistics, Communication, Journalism, Translation, or related fields
- C2-level English proficiency (mandatory)
- 2+ years of experience in AI Evaluation / LLM QA / Query Vetting
- Strong analytical and evaluation skills
Work Details
- Location: India (Remote)
- Hours: Up to 35 hours/week
- Must be comfortable with IST hours and overlap with PST/CST
Apply
Send your CV to: sajid.ahmed@truelancer.com
Click on Apply to know more.