
Senior AI Engineer – Ops
Latitude
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
Salary
💰 $150,000 - $250,000 per year
Job Level
About the role
- Build and maintain AI request handlers, generation configs, and routing logic for our third-party model inference providers
- Implement monitoring systems, dashboards, and alerting for production AI system health, performance, and costs
- Design metrics for analyzing the health and efficiency of our production AI resources
- Create agentic automations for common AI infrastructure tasks and analytics pipelines
- Manage database schemas for AI configurations and evaluation data
- Work with the team to define best practices for AI system reliability and observability
Requirements
- Knowledge of generative AI approaches, research landscape, and model inference configurations
- Strong coding skills in TypeScript/JavaScript, Python, or similar languages
- Experience building production systems with external APIs and managing third-party service integrations
- Familiarity with observability tools (Grafana, Prometheus, etc.) and databases (PostgreSQL)
- Ability to think systematically about reliability, performance, and cost trade-offs
- Comfortable working in a fast-paced environment where you'll need to balance quick iteration with production stability.
Benefits
- Medical, dental, and vision coverage, with the company paying 100% of premiums for employees and eligible dependents (subject to plan terms and eligibility; benefits vary by location).
- Company-provided laptop (Mac by default) and the tools you need to do your best work.
- Flexible PTO, encouraged and supported. Many teammates take around 2 days per month plus additional time each quarter, depending on role and team planning.
- Access to the latest AI models to accelerate your work.
- $100/month Learning Fund for books, courses, coaching, conferences, and video games.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
TypeScriptJavaScriptPythonAI request handlersmodel inference configurationsproduction systemsexternal APIsdatabase schemasobservabilityanalytics pipelines
Soft Skills
systematic thinkingreliabilityperformance analysiscost trade-offsadaptabilityquick iterationproduction stability