Senior Software Engineer

Akamai Technologies

Senior Software Engineer on Inference Execution & Runtimes team developing AI inference systems. Collaborating with experienced engineers to optimize and maintain AI inference workloads.

Posted 6/1/2026full-timeRemote • 🇵🇱 PolandSeniorWebsite

Tech Stack

Tools & technologies

GoLinuxPythonRust

About the role

Key responsibilities & impact

Developing and maintaining prompt processing and tokenization pipelines that prepare inference requests for efficient model execution.
Implementing request routing, scheduling, and batching logic that optimizes throughput and latency across concurrent inference workloads.
Contributing to the integration of new model architectures and serving backends into the runtime framework.
Writing well-tested, well-documented code and participating in code reviews to maintain high engineering standards across the inference stack.
Supporting operational readiness through monitoring, debugging, and performance analysis of runtime components.

Requirements

What you’ll need

Have relevant experience and a Bachelor's degree or its equivalent in Computer Science or a related field.
Demonstrate proficiency in Python and at least one systems programming language such as C++, Go, or Rust.
Show understanding of natural language processing concepts including tokenization, encoding, and text processing pipelines.
Have familiarity with AI inference, model serving, or LLM deployment including inference frameworks (TensorRT, vLLM, TorchServe, Triton).
Demonstrate experience building high-throughput, low-latency data processing systems or services.
Show familiarity with Linux systems, containerized environments, and profiling or debugging tools.
Demonstrate a keen willingness to learn and grow within the AI inference and model serving field.

Benefits

Comp & perks

We support your health, well-being, finances, and life beyond work.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonC++GoRustnatural language processingtokenizationencodingdata processing systemshigh-throughput systemslow-latency systems

Soft Skills

willingness to learncollaborationcode review participationdebuggingperformance analysis

Certifications

Bachelor's degree in Computer Science