Sourcebae
Website:
sourcebae.com
Company:
https://www.linkedin.com/company/sourcebae
Seniority: Mid-Senior level
Industries: Information Services
Job details:
🏛️ Hiring: Domain Expert – History
Experience: 3–6 Years
Work Mode: Remote
🕐 Work Shift
7:30 PM – 12:30 AM IST
Remaining 4 hours are flexible.
About the Role
We are looking for a highly qualified History Domain Expert to help evaluate and improve Large Language Models (LLMs).
You will leverage your expertise across Ancient, Medieval, Modern, Political, Military History, Archaeology, and Historiography to create challenging evaluations, assess AI-generated responses, identify knowledge gaps, and provide evidence-based feedback.
🎯 Key Responsibilities
- Create advanced, domain-specific prompts covering diverse areas of History.
- Evaluate AI-generated responses for factual accuracy, reasoning, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Compare and rank multiple AI-generated responses.
- Provide evidence-based feedback using reliable and authoritative references.
- Identify ambiguous questions and propose improved prompts.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and clear documentation.
🎓 Minimum Qualifications
- Master’s degree or higher in History or a closely related discipline.
- 3+ years of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
- Ability to work independently and provide objective, evidence-backed reviews.
⭐ Preferred Qualifications
- Experience with LLMs, Generative AI, Prompt Engineering, or AI Evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Strong research and source-validation skills.
Click on Apply to know more.