Medical Expert, AI Evaluation Specialist

Weekday (YC W21)

Medical Expert contributing clinical expertise to AI models for healthcare technology. Join a leading AI research initiative focused on advanced medical reasoning and patient care.

Posted 7/8/2026part-timeRemote • 🇺🇸 United StatesMid-LevelSenior💰 $130 - $180 per hourWebsite

About the role

Key responsibilities & impact

Contribute clinical expertise toward training and evaluating AI models for healthcare.
Help create realistic clinical scenarios and evaluate AI-generated responses.
Provide expert insights that improve AI systems' reasoning in medical contexts.
Produce high-quality clinical responses reflecting attending physician-level reasoning.
Evaluate AI performance and provide detailed feedback to enhance model accuracy.
Collaborate with multidisciplinary teams to ensure consistency in medical evaluations.

Requirements

What you’ll need

Applicants should meet one of the following criteria:
Attending Physicians
- Board-certified physician with a current, active, and unrestricted medical license.
Resident Physicians
- Currently in the final year of an accredited residency program.
- Recent residency graduates must be board-eligible.
Fellows
- Board-certified or board-eligible in their primary specialty.
- Current, active, and unrestricted medical license.
Physicians from a wide range of specialties are encouraged to apply, including but not limited to:
- Family Medicine
- Pediatrics
- Anesthesiology
- General Surgery
- ENT (Otolaryngology)
- Physical Medicine & Rehabilitation (PM&R)
- Occupational Medicine
- Other medical and surgical specialties
Strong understanding of evidence-based medicine and clinical practice guidelines.
Excellent written communication skills.
Experience with medical education, clinical research, peer review, or healthcare quality initiatives.
Interest in artificial intelligence and healthcare innovation.

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Weekday (YC W21) Website LinkedIn All Job Openings 11 - 50 employees Founded 2021 ☁️ SaaS 🎯 Recruiter Human Resources
SaaS
Recruitment Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies. Medical Expert, AI Evaluation Specialist Job not on LinkedIn 🔥 15 minutes ago 🇺🇸 United States – Remote 💵 $130 - $180 / hour ⏱ Part Time 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Contribute clinical expertise toward training and evaluating AI models for healthcare.
Help create realistic clinical scenarios and evaluate AI-generated responses.
Provide expert insights that improve AI systems' reasoning in medical contexts.
Produce high-quality clinical responses reflecting attending physician-level reasoning.
Evaluate AI performance and provide detailed feedback to enhance model accuracy.
Collaborate with multidisciplinary teams to ensure consistency in medical evaluations. 🎯 Requirements
Applicants should meet one of the following criteria:
Attending Physicians
- Board-certified physician with a current, active, and unrestricted medical license.
Resident Physicians
- Currently in the final year of an accredited residency program.
- Recent residency graduates must be board-eligible.
Fellows
- Board-certified or board-eligible in their primary specialty.
- Current, active, and unrestricted medical license.
Physicians from a wide range of specialties are encouraged to apply, including but not limited to:
- Family Medicine
- Pediatrics
- Anesthesiology
- General Surgery
- ENT (Otolaryngology)
- Physical Medicine & Rehabilitation (PM&R)
- Occupational Medicine
- Other medical and surgical specialties
Strong understanding of evidence-based medicine and clinical practice guidelines.
Excellent written communication skills.
Experience with medical education, clinical research, peer review, or healthcare quality initiatives.
Interest in artificial intelligence and healthcare innovation. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs AI Data Labeler 🕒 June 9 Mashgin 11 - 50 🤖 Artificial Intelligence 🛒 Retail 🏢 Enterprise Website LinkedIn All Job Openings Part-time contractor promoting Mashgin's Touchless Checkout System around New Hampshire. Showing users how to use the technology and resolving issues with flexible hours. 🇺🇸 United States – Remote 💵 $15 / hour 💰 $62.5M Series B on 2022-05 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence 🚫👨‍🎓 No degree required Subject Matter Expert – IT, Artificial Intelligence 🕒 May 29 Excelsior University 201 - 500 📚 Education 🤝 Non-profit Website LinkedIn All Job Openings Subject Matter Expert developing AI and computer science courses at Excelsior University. Design and revise course content while collaborating with faculty and staff. 🇺🇸 United States – Remote ⏱ Part Time 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence 🦅 H1B Visa Sponsor Pro Bono AI Strategy Expert 🕒 May 27 TechnoServe 1001 - 5000 Website LinkedIn All Job Openings Fellow supporting TechnoServe's Amplify AI Strategy initiative with 10-20 hours commitment. Focused on AI solutions for farmers and entrepreneurs in global markets. 🇺🇸 United States – Remote 💰 $3.5M Grant - TechnoServe on 2019-08 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence AI Solutions Specialist 🕒 May 22 ICF 5001 - 10000 ☁️ SaaS ⚡ Energy Website LinkedIn All Job Openings On-Call AI Solutions Specialist developing customized large language models within AWS for child welfare information. Focused on prompt engineering, model optimization, and AI integration into applications. 🇺🇸 United States – Remote 💵 $67.4k - $114.5k / year 💰 $30M Grant on 2021-03 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence 🦅 H1B Visa Sponsor Instructor, Agentic AI 🕒 May 20 Full Stack Academy 11 - 50 📚 Education Website LinkedIn All Job Openings Part-Time Instructor delivering engaging AI training sessions for adult learners online. Teaching modern generative models, LLMs, and prompt engineering. 🇺🇸 United States – Remote 💵 $60 / hour ⏱ Part Time 🟠 Senior 🔴 Lead 🤖 Artificial Intelligence View More Artificial Intelligence Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Clinical ExpertiseAI Model EvaluationMedical Scenario CreationPeer ReviewClinical Practice Guidelines

Soft Skills

Excellent Written Communication

Certifications

Current Medical LicenseBoard-Eligible