Senior Director, Inference Products, Optimizations

DigitalOcean

Senior Director of Engineering at DigitalOcean leading LLM inference product suite. Responsible for team leadership, product roadmap, and technical strategy in AI/ML systems.

Posted 7/16/2026full-timeRemote • California • 🇺🇸 United StatesSenior💰 $274,400 - $343,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive expertise in distributed systems design and modern AI/ML technologies, with a strong focus on leading technical teams and ensuring system stability. Proven ability to define product roadmaps and institutionalize best practices in infrastructure management.

Highest-signal resume keywords

Distributed Systems DesignTechnical LeadershipKubernetesAI/ML TechnologiesSystems Engineering

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringInfrastructure Metrics TrackingCloud-Native ArchitecturesGPU ArchitecturesHardware Optimization

Soft Skills

CommunicationMentoringCoachingOwnership

Tools & Technologies

KubernetesCloud-Native Technologies

Industry Keywords

Inference ProductsSystem StabilityInfrastructure Tuning

Tech Stack

Tools & technologies

CloudDistributed SystemsKubernetes

About the role

Key responsibilities & impact

Recruit, mentor, and coach engineers
Define and execute on the Product roadmap for DigitalOcean's Inference Products
Lead design and evolution of inference serving stack
Collaborate with Product Management and engineering teams
Ensure production health and stability of all systems
Institutionalize best practices for system and infrastructure tuning

Requirements

What you’ll need

10+ years of software engineering experience
6+ years in technical leadership or management role
Deep expertise in distributed systems design
Knowledge of modern AI/ML technologies
Experience with Kubernetes at scale
Understanding of cloud-native multi-region architectures
Familiarity with GPU architectures and hardware optimization
Strong systems engineering and security knowledge
Expertise in defining and tracking infrastructure metrics
Excellent communication and ownership skills

Benefits

Comp & perks

Competitive salary
Flexible time off policy
Employee Assistance Program
Local Employee Meetups
Professional development resources and reimbursement for relevant conferences, training, and education
LinkedIn Learning access
Bonus potential based on performance
Equity compensation including equity grants and Employee Stock Purchase Program