Senior II Software Engineer Lead – Akamai Inference Cloud

Akamai Technologies

Senior II Software Engineer Lead responsible for critical platform design and implementation at Akamai Inference Cloud. Collaborating on AI applications and guiding engineering teams for scalable solutions.

Posted 5/13/2026full-timeRemote • Massachusetts • 🇺🇸 United StatesSenior💰 $126,100 - $261,900 per yearWebsite

Tech Stack

Tools & technologies

CloudDistributed SystemsDockerGRPCKubernetes

About the role

Key responsibilities & impact

Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads
Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving
Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale
Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

Requirements

What you’ll need

8 years of relevant experience and a Bachelor's degree or its equivalent
Solid proficiency in distributed systems, cloud services, and platform engineering
Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton)
Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures
Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
Solid technical leadership through mentoring, code quality advocacy, and ability to drive technical solutions for complex problems
Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure and hardware acceleration
Knowledge of observability, monitoring, and debugging distributed systems

Benefits

Comp & perks

Healthcare
401K savings plan
Company holidays
Vacation (in the form of PTO)
Sick time
Family friendly benefits including parental leave
Employee assistance program including a focus on mental and financial wellness

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI inferencemodel servingLLM deploymentinference frameworksTensorRTvLLMTorchServeTritoncontainerizationorchestration

Soft Skills

technical leadershipmentoringcode quality advocacyproblem-solvingcollaboration