
Senior AI Engineer – AI Foundations, LLM Core
Capital One
full-time
Posted on:
Location Type: Office
Location: New York City • California, Massachusetts, New York, Virginia • 🇺🇸 United States
Visit company websiteSalary
💰 $158,600 - $197,400 per year
Job Level
Senior
Tech Stack
AWSGoJavaOpen SourcePythonPyTorchScala
About the role
- Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
- Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
- Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
- Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 1 year of experience developing AI and ML algorithms or technologies
- At least 3 years of experience programming with Python, Go, Scala, or Java
Benefits
- Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
AI software developmentML algorithmsfoundation model traininglarge language model inferencesimilarity searchmodel evaluationgovernanceobservabilityprogramming (Python, Go, Scala, Java)LLM optimization techniques
Soft skills
collaborationcommunicationtechnical visionroadmap development
Certifications
Bachelor's degree in Computer ScienceBachelor's degree in AIBachelor's degree in Electrical EngineeringBachelor's degree in Computer EngineeringMaster's degree in Computer ScienceMaster's degree in AIMaster's degree in Electrical EngineeringMaster's degree in Computer Engineering