Operations

• Lead, coach, and develop a team of program/project managers and human raters, fostering a collaborative, high-performance culture.
• Build and nurture strong relationships with Product, Research, Engineering, and Data Science partners to ensure human data operations are aligned with strategic priorities.
• Own the human annotations budget – overseeing vendor sourcing, contracts, and cost optimization to ensure financial sustainability and alignment with business needs.
• Design and manage end-to-end annotation workflows across evolving ML and GenAI use cases, from early pilots to scalable production systems (using available 3P or 1P tools).
• Balance competing evaluation needs, making clear prioritization decisions to maximize impact across multiple AI initiatives.
• Manage the human data support requests, handling intake, scoping, and resourcing strategy.
• Establish and monitor benchmarks for throughput, quality, cost-efficiency, and turnaround time.
• Pilot and partner with platform teams to integrate automated evaluations into HITL workflows to increase speed, scalability and efficiency.
• Define best practices for tooling, vendor engagement, and human data governance as we grow.
• Act as a strategic partner and internal advisor—helping teams adopt effective human data best practices and methodologies to power product/research insights and decisions.
• Develop playbooks, workflows, and lightweight documentation to ensure knowledge-sharing, repeatability, and scalability.
• Partner with Product, Engineering, and Data Science to measure and improve the human data impact on AI product and model development.

Data Operations Manager, Human Data Operations

Senior Retail Operations Specialist

Supervisor, Claim Adjudication Operations

National Operations Manager

Operations Analyst

Director, Oncology Patient Support Operations