AI Solutions Engineer
Hydra Host
full-time
Posted on:
Location Type: Hybrid
Location: Miami • Florida • 🇺🇸 United States
Visit company websiteSalary
💰 $150,000 - $225,000 per year
Job Level
Mid-LevelSenior
Tech Stack
AnsibleCloudDNSDockerGrafanaKubernetesLinuxPerlPrometheusPythonPyTorchRubyTCP/IPTerraform
About the role
- Prototype and operate proof-of-concept AI platforms and neo-clouds
- Build and maintain an open-source “neo-cloud in a box” reference implementation
- Dogfood Hydra’s APIs and infrastructure
- Run and validate the latest AI platforms, inference stacks, and orchestration frameworks
- Collaborate closely with product and engineering
Requirements
- NVIDIA GPU Stack — Deep knowledge of NVIDIA hardware (drivers, firmware, NVLink, NCCL, CUDA, libraries)
- Bare Metal Linux — Strong experience in bare-metal Linux systems administration
- AI Workloads — Proficiency running many various Hugging Face, PyTorch, model deployment frameworks
- AI Benchmarking - Hands-on experience benchmarking AI workloads
- Workload Orchestration — Experience running Kubernetes clusters, Slurm, and Ansible tools for cluster automation
- Scripting - Solid scripting skills (e.g., shell scripts, Perl, Ruby, Python)
- Networking — OSI Layer 2/Layer 3 fundamentals (TCP/IP, DNS)
- Observability and Monitoring - nvidia-smi profiling, Prometheus/ Grafana or ELK stack
- Container Runtimes - Containers like Docker, Podman, Singularity
- Cloud Provisioning - Terraform, Cloud-init, etc.
Benefits
- Equity ownership
- Competitive salary
- Healthcare coverage: Medical, dental, vision for you and your family
- Fully remote team
- Direct impact
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
NVIDIA GPU Stackbare-metal Linux systems administrationAI WorkloadsAI BenchmarkingWorkload OrchestrationscriptingNetworkingObservability and MonitoringContainer RuntimesCloud Provisioning
Soft skills
collaboration