OnJob.io
Medical Doctor (Specialist)
Medcruit
Sponsorship not confirmed
You apply on the original listing. Flieva never charges you to apply and never asks for payment for a job.
About the job
Medical Doctor (Specialist) – Clinical AI Evaluation & Medical Reasoning Up to $150/hour Remote | Independent Contractor | Interview Required Eligible locations: Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, the United States, Timor-Leste, and Vietnam. About the Role We are seeking experienced Medical Doctors and Specialist Physicians to contribute their clinical expertise to AI training and evaluation projects. You’ll review AI-generated clinical responses, develop expert medical content, and assess the quality of clinical reasoning, diagnostic decisions, and treatment recommendations within your specialty. Your work will focus on clinical accuracy, patient safety, evidence-based decision-making, and clear medical explanations. You’ll help identify errors in clinical methodology, assess the appropriateness of diagnostic and treatment approaches, and provide detailed feedback to improve AI performance. Important: There is no immediate project assignment for this opportunity. Qualified candidates may be contacted first when relevant projects become available and may gain access to future opportunities through the expert network. What You’ll Do Develop expert clinical content: Create detailed prompts and gold-standard answers aligned with your medical specialty, ensuring accuracy and appropriate clinical scope. Evaluate AI-generated responses: Assess clinical correctness, safety, clarity, and adherence to the original prompt. Review clinical reasoning: Identify errors in differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning. Fact-check medical information: Identify unsupported conclusions, unsafe assumptions, missing contraindications, inappropriate investigations or therapies, and misinterpreted results. Compare and rank responses: Evaluate multiple answers based on clinical accuracy, reasoning quality, safety, and contextual relevance. Provide structured feedback: Write clear explanations that demonstrate sound clinical reasoning and appropriate decision-making. Assess model reliability: Identify inaccuracies, unsafe recommendations, and potential biases across clinical scenarios and patient populations. Required Qualifications MD, DO, or equivalent medical degree, with completed specialty training through residency or fellowship, as applicable. Board eligibility or board certification, or the relevant local equivalent. At least 5 years of post-training clinical experience in a specialty setting, such as hospital, outpatient, academic, or community practice. Strong specialty-specific clinical reasoning, including differential diagnosis, triage, red-flag recognition, and escalation pathways. Solid understanding of disease processes, guideline-based care, diagnostic pathways, and patient safety considerations. Exceptional attention to detail when evaluating clinical content and identifying potential errors or unsafe recommendations. Minimum C1 English proficiency , with strong written communication skills. Ability to assess clinical consistency, including timelines, physiology, dosing, contraindications, care-setting appropriateness, and risk-benefit trade-offs. Ability to work independently and deliver consistent, high-quality evaluations in a remote contractor environment. Eligible Medical Specialties Board-certified or board-eligible specialists across a range of fields are welcome, including: Internal Medicine Family Medicine Emergency Medicine Pediatrics Obstetrics and Gynecology (OB/GYN) Cardiology Neurology Psychiatry General Surgery Anesthesiology Critical Care Radiology Oncology Dermatology Orthopedics Gastroenterology Pulmonology Nephrology Endocrinology Infectious Disease Pathology Preferred Experience AI data training, annotation, or model evaluation. Clinical guideline development or review. Utilization review and clinical documentation review. Healthcare editorial q
More jobs like this
Research Engineer, Cybersecurity RLAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingLegal Specialist, Law EnforcementAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingStaff+ Software Engineer, STEMAnthropicSan Francisco, CA | New York City, NY | Seattle, WA · United StatesSponsorship stated in listingBrand Strategy Lead, Brand Architecture & NamingAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listing
Flieva