Senior Distinguished Engineer, AI Compute

Capital One

Senior Distinguished Engineer at Capital One developing AI and ML infrastructure. Focused on architecting scalable solutions and leading technical execution across diverse projects.

Posted 5/9/2026full-timeRemote • California, Massachusetts, New York, Virginia • 🇺🇸 United StatesSenior💰 $286,200 - $392,000 per yearWebsite

Tech Stack

Tools & technologies

AWSDistributed SystemsEC2GoJavaMicroservicesPythonRayScalaSpark

About the role

Key responsibilities & impact

Architect and build control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform
Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit economics
Engineer systemic improvements for operational excellence including automating KTLO (Keep The Lights On) workflows
Direct the technical execution of a diverse project portfolio, collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models
Work cross-functionally with product and program management disciplines, and stakeholder and partners across Capital One to help optimize business outcomes while driving towards strong technology solutions
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and leading system design and code review sessions
Help elevate the Capital One Distinguished Engineering community and establish yourself as a go-to resource on given technologies and technology-enabled capabilities
Lead the way in creating next-generation talent, mentoring internal talent and actively recruiting external talent to bolster the Capital One tech talent pool.

Requirements

What you’ll need

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
At least 10 years of experience programming with Python, Go, Scala, or Java
Master’s Degree in Computer Science or a Master’s Degree in Software Engineering (Preferred)
Hands on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management) (Preferred)
Experience building platforms that support LLM training, fine-tuning, or high-throughput inference (Preferred)
Hands-on experience with AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton) and cost-optimization strategies (Preferred)
History of upstream contributions to major distributed systems projects (Preferred).

Benefits

Comp & perks

Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

machine learningAI algorithmsML algorithmsPythonGoScalaJavaRaySparkAWS

Soft Skills

collaborationmentoringleadershipcommunicationorganizational skillspassion for technologyexperimentationcommunity engagementtechnical executionoptimizing business outcomes

Certifications

Bachelor's degree in Computer ScienceBachelor's degree in AIBachelor's degree in Electrical EngineeringBachelor's degree in Computer EngineeringMaster's degree in Computer ScienceMaster's degree in Software Engineering