Building and maintaining infrastructure from first principles needed to deliver TensorRT LLM
Maintain CI/CD pipelines to automate the build, test, and deployment process and build improvements on the bottlenecks.
Managing tools and enabling automations for redundant manual workflows via Github Actions, Gitlab, Terraform, etc
Enable performing scans and handling of security CVEs for infrastructure components
Improve the modularity of our build systems using CMake
Use AI to help build automated triaging workflows
Extensive collaboration with cross-functional teams to integrate pipelines from deep learning frameworks and components is essential to ensuring seamless deployment and inference of deep learning models on our platform.

Requirements

Masters degree or equivalent experience
Experience in Computer Science, computer architecture, or related field
Ability to work in a fast-paced, agile team environment
Excellent Bash, CI/CD, Python programming and software design skills, including debugging, performance analysis, and test design.
Experience with CMake.
Background with Security best practices for releasing libraries.
Experience in administering, monitoring, and deploying systems and services on GitHub and cloud platforms.
Support other technical teams in monitoring operating efficiencies of the platform, and responding as needs arise.
Highly skilled in Kubernetes and Docker/containerd.
Automation expert with hands-on skills in frameworks like Ansible & Terraform.
Experience in AWS, Azure or GCP

Benefits

equity
benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonBashCMakeCI/CDKubernetesDockerAnsibleTerraformAWSAzure

Soft Skills

collaborationagile team environmentproblem-solvingperformance analysisdebuggingtest design

Certifications

Masters degree