Senior Engineering Manager, AI Quality – Governance

Mitratech

Senior Engineering Manager leading AI Quality & Governance functions at Mitratech. Responsible for building AI platforms, ensuring quality, and managing teams in a remote setup.

Posted 6/22/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $210,000 - $230,000 per yearWebsite

About the role

Key responsibilities & impact

Own the AI evaluations and observability platform — tracing, logs, dashboards, quality signals, and operational feedback loops for prompts, model calls, tool use, and user outcomes.
Design and operationalize automated and human-in-the-loop evaluation strategies, integrating regression checks for quality, safety, latency, and cost into engineering and release processes.
Establish the standards that define production-ready AI across the organization — evaluation criteria, release gates, incident playbooks, and long-term quality metrics.
Build and operate AI guardrails and policy enforcement capabilities: content controls, PII detection and redaction, audit logging, and request- or workflow-level policy checks.
Translate emerging governance and risk expectations into working engineering systems and platform controls rather than static documentation.
Own platform-level SLOs and tier-two incident support for AI behavior issues, partnering with product teams who remain first-line owners for features they ship.
Act as an internal authority on AI quality and governance and participate in customer-facing conversations where product quality, safety, observability, or governance posture must be explained credibly.
Hire, mentor, and grow the team over time — the combined function may later evolve into separate Quality/Observability and Governance/Policy teams.

Requirements

What you’ll need

8+ years of software engineering experience including meaningful experience leading engineers as a manager or technical lead.
Strong experience designing and operating production backend systems and APIs.
Demonstrated hands-on experience building, shipping, or operating production AI systems — ideally including LLM-powered or agentic workflows.
Experience with AI observability, evaluation, or debugging systems — whether through platforms such as LangSmith or LangFuse, or through internally built equivalents.
Practical experience designing or operating AI guardrails: content filtering, redaction, access controls, or other controls around model or agent behavior.
Familiarity with AI governance and risk frameworks such as NIST AI RMF or ISO/IEC 42001, and the ability to engage thoughtfully with legal, compliance, and security stakeholders.
A strong bias toward hands-on execution, platform thinking, and creating paved roads for other teams.

Benefits

Comp & perks

Health, Dental & Vision Insurance *
401 (k) + Employer Match *
Unlimited PTO + 11 Paid Holidays + 4 Annual Paid Global Wellness Days Off
STD, LTD & Group Life Insurance
Paid Parental Leave
Pet Insurance
FSA & HSA Options
Employee Assistance Program
Remote Work
Career Advancement & Professional Development Opportunities
Employee Recognition
LinkedIn Learning Platform

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

software engineeringproduction backend systemsAPIsAI systemsLLM-powered workflowsAI observabilityevaluation systemsdebugging systemsAI guardrailscontent filtering

Soft Skills

leadershipmentoringteam buildingcommunicationcollaborationproblem-solvingexecutionplatform thinking

Certifications

NIST AI RMFISO/IEC 42001