Principal Software Development in Test – Akamai Inference Cloud
Akamai Technologies
full-time
Posted on:
Location Type: Remote
Location: Remote • Massachusetts • 🇺🇸 United States
Visit company websiteSalary
💰 $148,200 - $307,800 per year
Job Level
Lead
Tech Stack
Distributed Systems
About the role
- Serve as the technical leader for quality, performance, and accuracy of AI inference platform
- Establish frameworks and methodologies for evaluating performance, quality, and reliability at scale
- Define quality standards for AI inference including evaluation methodologies
- Design and implement sophisticated testing strategies for LLM and inference workloads
- Build tools for continuous model validation and performance testing
- Collaborate with engineering and product teams to define quality requirements and acceptance criteria
Requirements
- 12 years of relevant experience
- Bachelor's degree or its equivalent
- Expertise in AI/ML quality assessment and model evaluation
- Extensive knowledge of LLM evaluation frameworks and metrics
- Mastery of test automation, CI/CD integration, and quality infrastructure for distributed systems
- Solid opinions on AI quality standards including model explainability and safety validation
- Excellent technical leadership abilities
Benefits
- Health insurance
- 401K savings plan
- Company holidays
- Vacation (in the form of PTO)
- Sick time
- Family friendly benefits including parental leave
- Employee assistance program including a focus on mental and financial wellness
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
AI inferencequality assessmentmodel evaluationLLM evaluation frameworkstest automationCI/CD integrationquality infrastructureperformance testingcontinuous model validationevaluation methodologies
Soft skills
technical leadership
Certifications
Bachelor's degree