Senior Director, Engineering – ML

Sr. Director of Engineering leading AI/ML Engineering team at Machinify.

Posted 5/26/2026full-timeRemote • 🇺🇸 United StatesSeniorWebsite

Tools & technologies

JavaPythonRustScala

Key responsibilities & impact

Lead and grow the AI/ML Engineering team, while coordinating execution across contributors including data scientists on collaborative projects.
Design, deliver and operate the core AI/ML platform: agent frameworks, evaluation harnesses, labeling systems, document processing systems, semantic search, knowledge bases, model hosting, and more.
Run AI/ML systems at scale in production with reliability, observability, performance, and incident response. Build a culture of operational excellence.
Create processes to ensure proof-of-concept code from Data Science can be designed as production-grade services.
Partner with the Chief AI Officer and Product Manager to build forward-looking product strategy. Drive structured thinking in ambiguity.
Run tight, streamlined stand-ups across engineering and data science. Do capacity planning for driving predictability and velocity around delivery.
Provide leadership in ensuring the cross-functional team can utilize AI technologies to accelerate team excellence in coding, PR reviews, testing, observability and incident response. Keep up with the latest developments in LLM/agent advances and modern AI/ML infrastructure.

What you’ll need

BS or MS in Computer Science (or equivalent experience).
5+ years managing teams of ~8+ engineers with hands-on technical leadership.
8+ years direct hands on technical contributor in backend services experience.
3+ years specifically building AI/ML production-grade services at scale for multiple use cases. Direct co-working with data science and engineering.
Strong in Java, Scala, Rust, or similar backend languages, plus Python.
Understanding of what it takes to productize ML/AI platforms — workflows, serving, observability, reliability, and scale.
Fluent enough in data science concepts to be a real partner to DS leadership.
Strong communicator, organized, and proactive.
Comfortable with ambiguity and taking the initiative.

Comp & perks

Work from anywhere in the US! Machinify is digital-first.
Top Medical/Dental/Vision offerings
FSA/HSA
Tuition reimbursement
Competitive salary, 401(k) with company match
Unlimited PTO
Additional health and wellness benefits and perks
Flexible and trusting environment where you’ll feel empowered to do your best work

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI/ML engineeringbackend servicesJavaScalaRustPythonproduction-grade servicesobservabilityreliabilityscalability

Soft Skills

leadershipcommunicationorganizationalproactivestructured thinkingcapacity planningcollaborationinitiativeadaptabilityproblem-solving

Certifications

BS in Computer ScienceMS in Computer Science