Sourcebae
Website:
sourcebae.com
Company:
https://www.linkedin.com/company/sourcebae
Seniority: Mid-Senior level
Industries: Information Services
Job details:
🌍 Hiring: Domain Expert – Geography
Experience: 3–6 Years
Work Mode: Remote
🕐 Work Shift
7:30 PM – 12:30 AM IST
Remaining 4 hours are flexible.
About the Role
We are looking for a highly qualified Geography Domain Expert to help evaluate and improve Large Language Models (LLMs).
You will leverage your expertise across Physical & Human Geography, GIS, Climate, Geopolitics, and Demographics to create challenging evaluations, assess AI-generated responses, identify knowledge gaps, and provide evidence-based feedback.
🎯 Key Responsibilities
- Create advanced, domain-specific prompts covering various areas of Geography.
- Evaluate AI-generated responses for factual accuracy, reasoning, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Compare and rank multiple AI-generated responses.
- Provide evidence-based feedback using reliable and authoritative references.
- Identify ambiguous questions and propose improved prompts.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and clear documentation.
🎓 Minimum Qualifications
- Master’s degree or higher in Geography or a closely related discipline.
- 3+ years of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
- Ability to work independently and provide objective, evidence-backed reviews.
⭐ Preferred Qualifications
- Experience with LLMs, Generative AI, Prompt Engineering, or AI Evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Strong understanding of GIS, climate, geopolitics, demographics, or spatial analysis.
Click on Apply to know more.