Sourcebae
Website:
sourcebae.com
Company:
https://www.linkedin.com/company/sourcebae
Seniority: Mid-Senior level
Industries: Information Services
Job details:
🎨 Hiring: Domain Expert – Art
Experience: 3–6 Years
Work Mode: Remote
🕐 Work Shift
7:30 PM – 12:30 AM IST
Remaining 4 hours are flexible.
About the Role
We are looking for a highly qualified Art Domain Expert to help evaluate and improve Large Language Models (LLMs).
You will use your expertise across Fine Arts, Visual Arts, Architecture, Design, Art History, Museums, and Artists to create challenging evaluations, assess AI-generated responses, identify knowledge gaps, and provide evidence-based feedback.
🎯 Key Responsibilities
- Create advanced, domain-specific prompts across various areas of Art.
- Evaluate AI responses for factual accuracy, reasoning, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Compare and rank multiple AI-generated responses.
- Provide evidence-based feedback using reliable and authoritative references.
- Identify ambiguous questions and suggest improved prompts.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and clear documentation.
🎓 Requirements
- Master’s degree or higher in a discipline related to Art.
- 3+ years of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
- Ability to provide objective, evidence-backed evaluations.
⭐ Preferred Qualifications
- Experience with LLMs, Generative AI, Prompt Engineering, or AI Evaluation.
- Published research, industry recognition, or teaching experience is a plus.
Click on Apply to know more.