
Manager, Generative AI Advisory and Oversight
Capital One
full-time
Posted on:
Location Type: Hybrid
Location: McLean • New York • Virginia • United States
Visit company websiteExplore more
Salary
💰 $179,400 - $245,600 per year
About the role
- Provide technical leadership in assessing the architecture, security requirements/controls, roadmaps, and reusable patterns for AI/ML system design and deployments (including Agentic AI frameworks), while providing oversight and effective challenge over the end-to-end AI/ML lifecycle
- Evaluate proposed and approved AI/ML technical solutions for automation, resiliency, performance, scalability, and security including appropriate tradeoffs, risks and opportunities
- Develop and maintain AI/ML risk guidance to ensure the safe adoption of emerging technologies, including governance for agentic AI components, establishing secure data/tool interaction models and how to maintain secure operational boundaries
- Evaluate the dynamic behavior of AI systems and oversee the development of key continuous monitoring controls and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk appetite
- Define requirements for AI observability, focusing on the traceability of autonomous decisions and comprehensive system audit trails
- Mentor junior risk associates to bring them up to speed on AI/ML architecture and risks, including Generative AI, AI Agents, and Agentic AI systems
- Build and maintain relationships with technical leaders, engineers, architects, and other stakeholders to understand and evaluate implementation plans, business priorities and technical solutions to ensure risks are well communicated and understood by key stakeholders
- Demonstrate enthusiasm for keeping current with AI/ML trends, actively experimenting with and learning new technologies, engaging in both internal and external technology communities, and providing mentorship to colleagues within the risk management and engineering sectors
- Demonstrate strong analytical, problem-solving, and decision-making skills
- Define, structure and plan work independently
- Translate complex ideas, technology, and programs into language executives can relate to and perform as a key influencer on technical decisions that affect the AI/ML platforms and systems
- Draft and communicate independent reports for broad audiences including executives, business leaders, product managers, legal experts, security specialists and software engineers
- Coordinate program-related activities and deliverables to ensure effective collaboration within the team and across stakeholder groups.
Requirements
- Bachelor's degree or military experience
- At least four years of experience in Technology Management or Cyber Risk Management
- At least one year of experience architecting, designing, developing, integrating, delivering, supporting or assessing complex AI systems
- 2+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
- Master's degree in Computer Science, Computer Engineering, or relevant technical field
- Experience assessing GenAI or LLM-Powered application architectures in production, including security best practices for Generative AI development and deployments
- Experience drafting and communicating reports or analytic assessments for executives
- Ability to communicate clearly and to interact effectively at all levels of the organization, and to influence as warranted and appropriate to drive to consensus
- Experience with identifying and communicating key risks related to AI/ML implementations and architectures
- Experience with risk analysis and reports that describe the risk implications to executives
- Ability to manage multiple high-visibility and high-impact projects while maintaining superior results
- Familiarity with AI controls and control frameworks (NIST AI Risk Management Framework, ISO 42001, OWASP Top 10 for LLM, MITRE ATLAS)
- Prior experience working in financial services or other highly-regulated sectors
Benefits
- Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI/ML system designAgentic AI frameworksAI observabilityGenerative AIAI Agentscloud platformsrisk analysissecurity best practicesscalable AI solutionscomplex AI systems
Soft Skills
technical leadershipanalytical skillsproblem-solvingdecision-makingcommunicationinfluencingmentoringrelationship buildingindependent workcollaboration