Software Engineer – Hosted Model Infrastructure

Palantir Technologies

Software Engineer enabling ML models in production environments at Palantir Technologies. Delivering new models and capabilities for critical customers with a focus on infrastructure and AI.

Posted 6/3/2026full-timeWashington, D.C. • Washington • 🇺🇸 United StatesMid-LevelSenior💰 $145,000 - $200,000 per yearWebsite

Tech Stack

Tools & technologies

JavaKubernetesPythonRust

About the role

Key responsibilities & impact

We are a software engineering team with expertise in enabling ML models in production.
We deploy AI models to run in a variety of environments.
Our customers rely on us for frontier AI capabilities running on hardware they control.
You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform.
The goal is to deliver new models and capabilities quickly and continuously.

Requirements

What you’ll need

4+ years of professional software engineering experience building and operating production systems
Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or similar field
Strong coding skills with demonstrated proficiency in programming languages, such as Java, C++, Python, Rust, or similar languages. Familiarity with the Python ML ecosystem is valuable.
Experience with containers, Kubernetes, and deploying backend services in production environments
Strong written and verbal communication skills and ability to iterate quickly with teammates, incorporating feedback and holding a high bar for quality

Benefits

Comp & perks

Employees (and their eligible dependents) can enroll in medical, dental, and vision insurance as well as voluntary life insurance
Employees are automatically covered by Palantir’s basic life, AD&D and disability insurance
Commuter benefits
Relocation assistance
Take what you need paid time off, not accrual based
2 weeks paid time off built into the end of each year (subject to team and business needs)
10 paid holidays throughout the calendar year
Supportive leave of absence program including time off for military service and medical events
Paid leave for new parents and subsidized back-up care for all parents
Fertility and family building benefits including but not limited to adoption, surrogacy, and preservation
Stipend to help with expenses that come with a new child
Employees can enroll in Palantir’s 401k plan

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

software engineeringprogramming languagesJavaC++PythonRustcontainersKubernetesproduction systemsML ecosystem

Soft Skills

strong written communicationstrong verbal communicationcollaborationfeedback incorporationquality assurance