
Manager – AI Analysis and Evaluation
Red Hat
full-time
Posted on:
Location Type: Hybrid
Location: Raleigh • Massachusetts • North Carolina • United States
Visit company websiteExplore more
Salary
💰 $148,540 - $245,050 per year
Tech Stack
About the role
- Lead and grow a technical sub-group focused on data science, data analysis, and AI evaluation functions
- Mature and accelerate the AI evaluations function, expanding its reach across the full portfolio of experiences we deliver
- Establish and report on key metrics that demonstrate the tangible impact and accuracy of our AI initiatives to executive leadership
- Advise stakeholders on impact measurements and provide clear visibility through data products like Tableau dashboards
- Advise development teams on AI evaluation responsibilities, best practices, and provide assistance
- Collaborate with platform managers to ensure our foundational infrastructure supports advanced analytics and innovative AI performance goals
- Remove roadblocks for your team by managing high-level strategy and fostering a culture of innovation and optimization
Requirements
- 5+ years of experience managing agile technical teams creating measurable impact against outcomes
- Experience managing data science and analytics functions
- Proficiency in the concepts and vocabulary of data science, AI engineering, and data analysis
- Professional experience establishing and maturing new technical functions or teams
- Excellent communication skills, with the ability to translate complex data insights for both technical teams and executive audiences
- Solid understanding of data visualization tools like Tableau
- Background in reviewing code or data models is a plus, though not required for daily tasks
- Experience with AI/ML frameworks or AI evaluations is a plus.
Benefits
- Comprehensive medical, dental, and vision coverage
- Flexible Spending Account - healthcare and dependent care
- Health Savings Account - high deductible medical plan
- Retirement 401(k) with employer match
- Paid time off and holidays
- Paid parental leave plans for all new parents
- Leave benefits including disability, paid family medical leave, and paid military leave
- Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data sciencedata analysisAI evaluationagile managementdata visualizationAI/ML frameworksimpact measurementdata productscode reviewdata modeling
Soft Skills
leadershipcommunicationcollaborationstrategic managementinnovationoptimizationstakeholder advisingproblem-solvingteam managementtranslating insights