Internal Medicine AI Evaluation Specialist

Weekday (YC W21)

Internal Medicine physician evaluating AI-generated clinical responses and developing case studies for healthcare-focused AI. Collaborate with multidisciplinary teams to enhance clinical decision-making processes.

Posted 7/8/2026part-timeRemote • 🇺🇸 United StatesMid-LevelSenior💰 $130 - $180 per hourWebsite

About the role

Key responsibilities & impact

Develop realistic Internal Medicine case studies based on everyday clinical practice
Create prompts covering diagnostic reasoning, treatment planning, and guideline adherence
Produce attending physician-level reference solutions that reflect current clinical best practices
Review and assess AI-generated clinical responses using structured evaluation frameworks
Participate in onboarding sessions and specialty calibration meetings

Requirements

What you’ll need

Board-certified in Internal Medicine or board-eligible as a final-year resident or fellow
Current, active, and unrestricted medical license
Expertise in Internal Medicine subspecialties (e.g. Cardiology, Hematology & Oncology, Endocrinology, Nephrology, Gastroenterology, Pulmonology)
Strong knowledge of evidence-based medicine and clinical practice guidelines
Experience in clinical teaching, medical research, or quality improvement initiatives
Excellent written communication and analytical skills
Interest in artificial intelligence, clinical decision support, or healthcare technology

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Weekday (YC W21) Website LinkedIn All Job Openings 11 - 50 employees Founded 2021 ☁️ SaaS 🎯 Recruiter Human Resources
SaaS
Recruitment Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies. Internal Medicine AI Evaluation Specialist Job not on LinkedIn 🔥 33 minutes ago 🇺🇸 United States – Remote 💵 $130 - $180 / hour ⏱ Part Time 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Develop realistic Internal Medicine case studies based on everyday clinical practice
Create prompts covering diagnostic reasoning, treatment planning, and guideline adherence
Produce attending physician-level reference solutions that reflect current clinical best practices
Review and assess AI-generated clinical responses using structured evaluation frameworks
Participate in onboarding sessions and specialty calibration meetings 🎯 Requirements
Board-certified in Internal Medicine or board-eligible as a final-year resident or fellow
Current, active, and unrestricted medical license
Expertise in Internal Medicine subspecialties (e.g. Cardiology, Hematology & Oncology, Endocrinology, Nephrology, Gastroenterology, Pulmonology)
Strong knowledge of evidence-based medicine and clinical practice guidelines
Experience in clinical teaching, medical research, or quality improvement initiatives
Excellent written communication and analytical skills
Interest in artificial intelligence, clinical decision support, or healthcare technology Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs AI Data Labeler 🕒 June 9 Mashgin 11 - 50 🤖 Artificial Intelligence 🛒 Retail 🏢 Enterprise Website LinkedIn All Job Openings Part-time contractor promoting Mashgin's Touchless Checkout System around New Hampshire. Showing users how to use the technology and resolving issues with flexible hours. 🇺🇸 United States – Remote 💵 $15 / hour 💰 $62.5M Series B on 2022-05 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence 🚫👨‍🎓 No degree required Subject Matter Expert – IT, Artificial Intelligence 🕒 May 29 Excelsior University 201 - 500 📚 Education 🤝 Non-profit Website LinkedIn All Job Openings Subject Matter Expert developing AI and computer science courses at Excelsior University. Design and revise course content while collaborating with faculty and staff. 🇺🇸 United States – Remote ⏱ Part Time 🟡 Mid-level 🟠 Senior 🤖 Artificial Intelligence 🦅 H1B Visa Sponsor Pro Bono AI Strategy Expert 🕒 May 27 TechnoServe 1001 - 5000 Website LinkedIn All Job Openings Fellow supporting TechnoServe's Amplify AI Strategy initiative with 10-20 hours commitment. Focused on AI solutions for farmers and entrepreneurs in global markets. 🇺🇸 United States – Remote 💰 $3.5M Grant - TechnoServe on 2019-08 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence AI Solutions Specialist 🕒 May 22 ICF 5001 - 10000 ☁️ SaaS ⚡ Energy Website LinkedIn All Job Openings On-Call AI Solutions Specialist developing customized large language models within AWS for child welfare information. Focused on prompt engineering, model optimization, and AI integration into applications. 🇺🇸 United States – Remote 💵 $67.4k - $114.5k / year 💰 $30M Grant on 2021-03 ⏱ Part Time 🟢 Junior 🟡 Mid-level 🤖 Artificial Intelligence 🦅 H1B Visa Sponsor Instructor, Agentic AI 🕒 May 20 Full Stack Academy 11 - 50 📚 Education Website LinkedIn All Job Openings Part-Time Instructor delivering engaging AI training sessions for adult learners online. Teaching modern generative models, LLMs, and prompt engineering. 🇺🇸 United States – Remote 💵 $60 / hour ⏱ Part Time 🟠 Senior 🔴 Lead 🤖 Artificial Intelligence View More Artificial Intelligence Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Diagnostic ReasoningTreatment PlanningGuideline AdherenceClinical Practice GuidelinesMedical ResearchQuality Improvement InitiativesCase Study DevelopmentClinical Evaluation Frameworks

Soft Skills

Excellent Written CommunicationAnalytical Skills

Certifications

Board-Certified In Internal MedicineActive Medical License