Staff AI Engineer

Capital One

Staff AI Engineer building responsible, scalable LLM infrastructure for Capital One’s banking products. Optimizing model training, inference, search, guardrails, and production AI performance.

Posted 9/4/2026full-timeSan Francisco • California, Massachusetts, New York, Virginia • 🇺🇸 United StatesLead💰 $269,100 - $335,100 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on optimizing performance and scalability in production environments. Proficient in leveraging cloud platforms and open-source technologies to deliver innovative AI solutions.

Highest-signal resume keywords

AI And ML Algorithm DevelopmentPython ProgrammingAWS Cloud DeploymentLLM Optimization TechniquesCross-Functional Leadership

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Software DevelopmentMachine Learning AlgorithmsFoundation Model TrainingLLM InferenceSimilarity SearchModel EvaluationExperimentationGovernanceObservabilityProgramming Languages

Soft Skills

Excellent CommunicationPresentation SkillsMentoring

Tools & Technologies

AWS UltraclustersHugging FaceVectorDBsNeMo GuardrailsPyTorchGoogle CloudAzure

Certifications & Qualifications

Bachelor's Degree in Computer ScienceMaster's Degree in AI or Related Fields

Industry Keywords

AI-Powered ProductsScalable AI SolutionsComplex AI SystemsTechnical VisionLong-Term Roadmap

Tech Stack

Tools & technologies

AWSAzureC++CloudGoJavaPythonPyTorchScala

About the role

Key responsibilities & impact

Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
Leverage open-source and SaaS AI technologies including AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch
Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems
Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Requirements

What you’ll need

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in one of these fields plus at least 6 years of such experience
At least 8 years of programming experience with Python, Go, Scala, or Java
Preferred: 8 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
Preferred: Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems
Preferred: Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level
Preferred: Experience developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang
Preferred: Experience applying state-of-the-art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost
Preferred: Passion for current AI research and AI systems, and ability to apply novel techniques in production
Preferred: Excellent communication and presentation skills for articulating complex AI concepts

Benefits

Comp & perks

Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI)
Comprehensive health, financial, and other benefits supporting total well-being
Employment authorization sponsorship may be considered for a new qualified applicant
Reasonable accommodations available for applicants who require them