Lead AI Engineer, AI Foundations

Lead AI Engineer developing AI-powered products at Capital One. Collaborating with cross-functional teams to deliver innovative AI solutions.

Posted 4/24/2026full-timeNew York City • California, Massachusetts, New York, Virginia • 🇺🇸 United StatesSenior💰 $197,300 - $245,600 per yearWebsite

Tools & technologies

AWSAzureCloudGoJavaOpen SourcePythonPyTorchScala

Key responsibilities & impact

Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Invent and introduce state-of-the-art LLM optimization techniques to improve performance of large scale production AI systems
Contribute to the technical vision and the long term roadmap of foundational AI systems

What you’ll need

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies,
A Master's degree in related fields plus at least 2 years of experience developing AI and ML algorithms or technologies
At least 4 years of experience programming with Python, Go, Scala, or Java
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
Experience designing, developing, delivering, and supporting AI services
Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost

Comp & perks

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI software developmentML algorithmsPythonGoScalaJavalarge language model inferencemodel evaluationoptimization techniquescloud deployment

Soft Skills

collaborationcommunicationtechnical visionroadmap development

Certifications

Bachelor's degree in Computer ScienceMaster's degree in related fields