Senior GPU Infrastructure Engineer

decircle

Senior Infrastructure Engineer for GPU Cloud Marketplace at Hyperbolic Labs. Building multi-tenancy provisioning solutions to transform global GPU resources into usable cloud infrastructure.

Posted 5/15/2026full-timeRemote • California • 🇺🇸 United StatesSeniorWebsite

Tech Stack

Tools & technologies

CloudDistributed SystemsTerraform

About the role

Key responsibilities & impact

Help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution
Responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers
Work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers

Requirements

What you’ll need

Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
Proficiency with API design and cloud-init for automated provisioning and configuration
Solid understanding of GPU architecture, CUDA, and GPU compute optimization
Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
Experience building and scaling cloud infrastructure or distributed systems in production environments

Benefits

Comp & perks

🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account decircle Website LinkedIn All Job Openings 1 - 10 employees Founded 2019 We partner with disruptive organizations to help identify and attract talent. A boutique recruitment agency that focuses on blockchain and web3. We enjoy networking with Web3 and decentralization enthusiasts and help them find their place in the decentralized world. Senior GPU Infrastructure Engineer Job not on LinkedIn 🔥 2 hours ago 🏄 California – Remote ⏰ Full Time 🟠 Senior 👷 Infrastructure Engineer Cloud Distributed Systems Terraform Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
Help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution
Responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers
Work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers 🎯 Requirements
Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
Proficiency with API design and cloud-init for automated provisioning and configuration
Solid understanding of GPU architecture, CUDA, and GPU compute optimization
Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
Experience building and scaling cloud infrastructure or distributed systems in production environments Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Infrastructure Engineer 🔥 4 hours ago Method Workers' Comp 51 - 200 🤝 B2B 🏢 Enterprise Website LinkedIn All Job Openings Infrastructure Engineer designing, implementing, and managing AWS cloud infrastructure at Attune. Collaborating closely with engineering, data, and product teams to ensure reliable and scalable systems. 🇺🇸 United States – Remote 💵 $120k - $140k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior 👷 Infrastructure Engineer AWS Cloud Distributed Systems Docker Jenkins Kubernetes Linux Python Terraform Go Infrastructure Specialist 🔥 8 hours ago Kyndryl 10,000+ employees 🏢 Enterprise 🔒 Cybersecurity ☁️ SaaS Website LinkedIn All Job Openings Infrastructure Specialist managing technology systems at Kyndryl. Involved in project-based expertise across infrastructure, ensuring optimal performance and strategic execution. 🇺🇸 United States – Remote 💵 $100.1k - $190.1k / year ⏰ Full Time 🟡 Mid-level 🟠 Senior 👷 Infrastructure Engineer 🦅 H1B Visa Sponsor AWS Cloud Linux Infrastructure Engineer 🔥 14 hours ago Jito Labs 1 - 10 Website LinkedIn All Job Openings Infrastructure Engineer responsible for operating end-to-end infrastructure for high-performance trading platform on Solana. Focusing on cloud environments, automation, and security tasks. 🇺🇸 United States – Remote 💰 $10M Series A on 2022-08 ⏰ Full Time 🟡 Mid-level 🟠 Senior 👷 Infrastructure Engineer Ansible Cloud DNS Grafana Linux Prometheus Terraform Vault Senior Infrastructure Engineer, Government Systems 🔥 23 hours ago Chainalysis Inc. 501 - 1000 🔌 API 💳 Fintech 🔒 Cybersecurity Website LinkedIn All Job Openings Senior Infrastructure Engineer responsible for cloud infrastructure and Kubernetes operations at Chainalysis. Leading architectural decisions and mentoring engineers for high-security deployment platforms. 🇺🇸 United States – Remote 💵 $150k - $200k / year 💰 $170M Series F on 2022-05 ⏰ Full Time 🟠 Senior 👷 Infrastructure Engineer AWS Cloud EC2 Flux Jenkins Kubernetes Linux Shell Scripting Terraform Infrastructure Engineer II 🕒 Yesterday Bullhorn 1001 - 5000 👥 HR Tech ☁️ SaaS 🎯 Recruiter Website LinkedIn All Job Openings Infrastructure Engineer II managing datacenter operations and server administration at Bullhorn. Focused on high-quality service delivery and infrastructure project management in a dynamic setting. 🇺🇸 United States – Remote 💵 $81k - $106.3k / year 💰 Private Equity Round on 2020-09 ⏰ Full Time 🟠 Senior 🔴 Lead 👷 Infrastructure Engineer 🦅 H1B Visa Sponsor AWS Azure Cloud Google Cloud Platform Linux NFS TCP/IP View More Infrastructure Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

bare-metal provisioninglifecycle managementGPU schedulingorchestrationinfrastructure engineeringDevOps engineeringTerraformPulumiAPI designCUDA

Soft Skills

collaborative team playerexcellent communication skills