Baseten

Full-stack Engineer

• Iterate like crazy
• Design ergonomic APIs and abstractions to model complex resources and lifecycles
• Work throughout the stack (API layer, backend and database implementation, infra layer; frontend is a plus) to implement features.
• Fine-tune and deploy models to develop intuition around training workflows.
• Partner closely with model developers and world-class research engineers to understand the requirements and pain points of post-training workflows.
• Drive long-term improvements to improve reliability of systems and velocity of development
• Fix bugs & resolve customer issues with urgency

Senior Product Engineer – Training Platform

• Performance Benchmarking: Run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse).
• Infrastructure Validation: Create automated acceptance tests for new GPU clusters across x86 and ARM systems, measuring GPU memory bandwidth, networking throughput, and multi-node networking performance.
• Model Dev Experience: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
• Tool Development: Build and contribute to tools such as InferenceMAX and genai-bench to automate model evaluation and optimization.
• Deep Hardware Profiling: Use PyTorch Profiler and NVIDIA Nsight Systems to collect performance profiles, identify bottlenecks, and debug the NVIDIA compute/networking stack.
• Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
• Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions in model setups before they hit production.
• Optimization Automation: Build tools to find the "Pareto frontier"—identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.

Senior Product Engineer – Training Platform

Software Engineer, Model Performance Tooling