
Senior AI Engineer – FM Hosting, LLM Inference
Capital One
full-time
Posted on:
Location Type: Office
Location: McLean • California • New York • United States
Visit company websiteExplore more
Salary
💰 $161,800 - $201,400 per year
Job Level
About the role
- Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
- Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
- Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
- Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 1 year of experience developing AI and ML algorithms or technologies
- At least 3 years of experience programming with Python, Go, Scala, or Java
Benefits
- 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI software developmentML algorithmsfoundation model traininglarge language model inferencesimilarity searchmodel evaluationexperimentationgovernanceobservabilityprogramming (Python, Go, Scala, Java)
Certifications
Bachelor's degree in Computer ScienceMaster's degree in Computer Science