ML/LLM Operations Engineer
Evolent
AWSAzureCloudDockerPythonSQL
Director of Operations, Design & Strategy
Mainstay
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteSalary
💰 $156,400 - $230,000 per year
Job Level
Lead
Tech Stack
SQL
About the role
- Own outcomes for one business line, including KPIs such as cost per unit, cycle time, forecast accuracy, and NPS; set targets and publish variance drivers monthly.
- Work cross functionally w/ departmental leaders to own the P&L performance of the business line.
- Run the operating cycle end to end: annual/quarterly planning, resource prioritization, OKRs, risk register, and executive readouts.
- Stand up standard work and SOPs across markets; roll out workflow/BI/LLM-assisted tooling with training and adoption plans.
- Define the experimentation framework: success criteria, guardrails/sample sizes, decision gates, and how wins graduate to BAU.
- Build the analytics backbone with Data: metric definitions, lineage, access controls, and a single source of truth.
- Create mechanisms that scale: intake and triage, change management, incident playbooks, and weekly business reviews with owners and due dates.
- Partner with Product and Engineering on roadmap trade-offs; write decision briefs with options, risks, and decision owners to secure alignment fast.
- Lead and develop a small BizOps team; run hiring loops, calibrations, and growth plans tied to observable behaviors.
- Meet with institutional customers regularly and convert structured insights into prioritized backlog items with owners and timelines.
Requirements
- 8-12 years in strategy/operations (or comparable experience) with 3+ years leading managers and ICs.
- Proven business-line ownership with clear KPI accountability and real trade-offs managed.
- Systems thinker who simplifies complexity into a few durable mechanisms and retires what no longer serves.
- Strong judgment in uncertainty: fast on reversible calls, rigorous on irreversible ones.
- Inclusive people leader who hires thoughtfully, sets unambiguous expectations, and develops talent.
- Change driver with adoption at scale across teams or markets, not just pilots.
- Data-literate decision maker; comfortable modeling in Sheets/Excel and partnering with Analytics/BI. SQL is required.
- Executive-ready communicator who aligns Product, Engineering, Revenue, Fulfillment, and Finance.
- Customer mindset that turns qualitative signal into prioritized outcomes.
- Nice to have: experience in SFR/real estate, fintech, or logistics-heavy operations.
Benefits
- Offers Equity 📊 Resume Score Upload your resume to see if it passes auto-rejection tools used by recruiters Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
KPI accountabilitydata modelingSQLchange managementrisk registerOKRsbusiness analyticsworkflow toolingSOPsforecast accuracy
Soft skills
inclusive leadershipstrategic thinkingjudgment in uncertaintycommunicationteam developmentcross-functional collaborationcustomer-focused mindsetdecision-makingsimplifying complexityfast decision-making
