Role Overview: Seeking experienced US-based Medical Doctors (MD) or international equivalents (MBBS, MBChB, Medical Diploma, etc.) to evaluate and enhance large language model (LLM) outputs in the medical domain. The role involves assessing AI-generated clinical content for medical accuracy, safety, and relevance, contributing to the development of responsible AI in healthcare.
Responsibilities:
- Review AI-generated medical text for accuracy, harmfulness, and completeness with a focus on the medical field.
- Evaluate diagnoses, treatment plans, and summaries for medical cases.
- Provide expert feedback to improve the medical integrity and safety of LLM outputs.
- Collaborate with AI researchers and clinicians to align model performance with evidence-based medical standards.
Qualifications:
- Based in the United States (mandatory).
- Medical Doctor (MD) or international equivalent (MBBS, MBChB, Medical Diploma, etc.).
- Fully licensed and practicing medicine within the USA.
- Minimum 1 year post-residency experience practicing as a Medical Doctor / General Physician (no specific specialization required).
- Strong attention to detail.
- Technically savvy—able to navigate web-based annotation platforms, use image zoom/tools, follow detailed guidelines, and accurately complete structured questionnaires.
- Experience in medical content review, clinical research, annotation, or AI/ML evaluation preferred.
Location: Remote (USA based)
Compensation: Up to $155 per hour
