AI Risk, Responsible AI Specialist
C-Serv
full-time
Posted on:
Location Type: Hybrid
Location: Portland • Idaho • Nevada • United States
Visit company websiteExplore more
Tech Stack
About the role
- Design and implement model evaluation frameworks across AI products
- Develop methodologies for:
- - Bias and fairness testing
- - Hallucination and reliability assessment
- - Robustness and stress testing
- - Safety benchmarking
- Evaluate training data governance practices
- Review RAG systems for retrieval accuracy and exposure risks
- Establish measurable risk metrics across AI deployments
- Align evaluation outputs with:
- - NIST AI Risk Management Framework
- - ISO 27701 privacy requirements
- - Enterprise governance standards
- Produce structured, executive-ready documentation
- Partner with product and engineering teams to integrate risk mitigation strategies
Requirements
- Experience designing model evaluation frameworks
- Familiarity with bias detection methodologies
- Understanding of hallucination testing and reliability measurement
- Experience stress-testing LLM-based systems
- Strong Python and experimentation capabilities
- Knowledge of NIST AI RMF
- Familiarity with privacy-by-design principles
- Experience operating within ISO 27001 / SOC 2 environments
- Understanding of enterprise AI risk posture expectations
- Ability to translate model risk into business impact
- Strong documentation skills
- Comfortable presenting findings to executive audiences
- Systems-thinking mindset
Benefits
- Comprehensive Private Medical Coverage
- Support for Mental Health Expenses
- Life Insurance Options
- Attractive Compensation Package
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
model evaluation frameworksbias detection methodologieshallucination testingreliability measurementstress testingPythonrisk metricsdata governance practicesRAG systemsprivacy-by-design principles
Soft Skills
strong documentation skillssystems-thinking mindsetability to translate model risk into business impactcomfortable presenting findingspartnering with teams
Certifications
ISO 27001SOC 2