Post Doctoral Researcher, Evaluation & Standards, Clinical Operations

Johnson & Johnson

Postdoctoral Researcher developing evaluation frameworks for AI agents in clinical operations across global development contexts. Contributing to approaches in evaluating AI within a regulated pharma organization.

Posted 5/26/2026full-timeBeerse • 🇧🇪 BelgiumMid-LevelSenior💰 €60,000 - €96,255 per yearWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Develop evaluation frameworks and rubrics for AI agents operating in clinical operations and global development contexts
Define quality dimensions for specialized outputs, e.g. clinical data queries, anomaly detection, protocol Q&A responses, ICF content, regulatory documents
Design and run human evaluation protocols with clinical, regulatory, and site-facing subject matter experts
Build benchmark datasets and evaluation pipelines that the broader GenAI organization uses across AI applications
Partner with our AI engineering teams to translate evaluation findings into measurable improvement
Contribute to the methodology of how a regulated pharma organization evaluates AI in clinical work

Requirements

What you’ll need

Strong understanding of clinical operations and global development workflows
Familiarity with how clinical-ops specialists, monitors, regulatory authors, and site teams actually do their work and assess quality
PhD or equivalent research experience in a clinical, biomedical, regulatory, biostatistics, or closely related field
Genuine interest in working hands-on with generative AI and agentic systems
Curiosity about how LLMs behave in specialized domains and where they fail
Comfort prototyping with modern AI tooling (LLM APIs, vector databases, evaluation frameworks)
Demonstrated ability to develop frameworks, rubrics, and structured assessment protocols
Experience designing evaluations with multiple quality dimensions, expert raters, or non-trivial inter-rater reliability considerations
Strong analytical and writing skills; comfort with ambiguity and unsolved problems
Practical skills in Python and the modern ML/data stack
Comfort working across disciplines (e.g., clinical operations, regulatory affairs, AI engineering, data science)

Benefits

Comp & perks

an annual bonus with set target (% of pay)
vacation days
parental leave for a minimum of 12 weeks
bereavement leave
caregiver leave
volunteer leave
well-being reimbursement
programs for financial, physical and mental health
service anniversary and recognition awards
participation in several insurance plans

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

evaluation frameworksrubricsclinical data queriesanomaly detectionprotocol Q&A responsesICF contentregulatory documentsPythonML/data stackevaluation protocols

Soft Skills

analytical skillswriting skillscuriositycomfort with ambiguityproblem-solvingcollaborationinterdisciplinary communicationability to assess qualityhands-on experienceability to develop frameworks

Certifications

PhDequivalent research experience