DigitalOcean

Senior Engineer 2 – Inference Optimizations

DigitalOcean

full-time

Posted on:

Location Type: Remote

Location: MassachusettsUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $167,200 - $209,000 per year

Job Level

About the role

  • Lead technical strategy for benchmarking and performance optimizations
  • Engineer solutions for complex performance issues
  • Proactively implement cutting-edge optimization techniques
  • Act as subject matter expert on GPU families and software stacks
  • Lead by example through high-quality code and design reviews
  • Partner with Product Management and TPMs for product features
  • Maintain presence in the GPU optimization communities

Requirements

  • 5+ years of experience in high-performance computing or AI infrastructure
  • Deep familiarity with the Gen AI landscape
  • Hands-on experience with attention-layer optimizations
  • Comprehensive understanding of NVIDIA and AMD GPU architectures
  • Extensive experience integrating, building with, and contributing to open-source software projects
  • Excellent system design skills related to low-level GPU programming
  • Experience acting as a technical lead
Benefits
  • Competitive salary
  • Flexible working hours
  • Paid time off
  • Professional development opportunities
  • Employee stock purchase program
  • Bonus eligibility
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
high-performance computingAI infrastructureattention-layer optimizationsNVIDIA GPU architectureAMD GPU architectureopen-source softwarelow-level GPU programmingperformance optimization techniquesbenchmarkingtechnical leadership
Soft Skills
leadershipcommunicationcollaborationproblem-solvingdesign review