Senior Software Engineer – AI Infrastructure
Montauk Capital
full-time
Posted on:
Location Type: Hybrid
Location: Washington, D.C. • District of Columbia, Washington • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AWSCloudDistributed SystemsGoGoogle Cloud PlatformKubernetesRust
About the role
- Designing, developing, and maintaining software solutions with a focus on distributed systems, GPU orchestration, capacity planning and resource scheduling
- Building high performance distributed networking components
- Thriving in ambiguity and shipping code that solves real problems
Requirements
- Hacker who loves to build
- Experience with Golang, Rust
- Understanding of infrastructure AWS, GCP, Kubernetes
- Nix experience
- (Ideally) hands-on experience with ML infrastructure (vLLM, GPU orchestration, model serving) or a strong desire to learn
- Strong adoption of AI tools for writing code, increasing personal productivity, and helping to rapidly build high quality software
- Deep love of cloud, infrastructure, distributed systems and building large scale systems
- An interest and understanding of the zeitgeist of the AI space: current models, practices, applications being built on AI models, and the emergent SOTA in research
- Ability to design scalable and efficient software architecture
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
GolangRustAWSGCPKubernetesNixML infrastructureGPU orchestrationmodel servingsoftware architecture
Soft skills
problem-solvingadaptabilityproductivityinterest in AIdesign skills