Salary
💰 $215,000 - $230,000 per year
About the role
- Design, build, and own a production-grade evaluation system that drives measurable improvements in model accuracy and latency.
- Lead experimentation, fine-tuning, and feedback-based evaluation loops for continuous model optimization.
- Advance the orchestration of AI/ML systems, ensuring scalable, resilient, and high-impact deployments.
- Elevate technical standards through engineering craftsmanship, mentorship, and leadership as a senior IC.
- Collaborate with cross-functional partners across a globally distributed AI Engineering team.
- Support on-call rotations to ensure Analytics and Data Science pipelines operate smoothly and resolve critical issues quickly.
Requirements
- Advanced programming expertise in Python and SQL, with strong system design skills.
- Deep experience deploying machine learning/deep learning models in production (LLM/GenAI strongly preferred).
- Strong foundation in experimentation frameworks, evaluation metrics, and ML Ops practices.
- Proven ability to own critical systems end-to-end and collaborate effectively with cross-functional partners.
- Senior individual contributor: elevate technical standards through engineering craftsmanship, mentorship, and leadership.
- Must have at least 4 hour overlap with PST business hours; most team overlap between 7am-12pm PST.
- Participate in on-call rotations: Analytics on-call (avg < 1 hour/day monthly) and Data Science on-call (full week on-call, avg 1-2 hours/day every 3 months).