Product Manager, Applied AI – Staff/Senior Staff

PermitFlow

Product Manager building AI agents and evaluation infrastructure for PermitFlow, an applied AI company transforming construction permitting. Owning automation, quality standards, and human-in-the-loop workflows from New York City.

Posted 8/9/2026full-timeNew York City • New York • 🇺🇸 United StatesSenior💰 $230,000 - $300,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in AI infrastructure and workflow automation, with a strong focus on quality assurance and compliance in permit submissions. Proven ability to collaborate across teams and translate operational insights into effective product strategies.

Highest-signal resume keywords

Product Management ExperienceAI/Agentic System Quality OwnershipBuilding Evaluations and Golden Data SetsTechnical Fluency in Engineering ConceptsCross-Functional Team Collaboration

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Infrastructure ManagementWorkflow AutomationQuality AssuranceError AnalysisHuman-in-the-Loop SystemsData Flywheel DevelopmentProduct DeliveryOperational Insight TranslationEvaluation BuildingCompliance Submission

Soft Skills

High Sense of OwnershipUrgencyAccountabilityAbility to Operate in AmbiguityClarity Creation

Tools & Technologies

Internal Testing ToolsDesign SystemsUser Feedback MechanismsLLM-as-JudgeHuman Annotation Tools

Industry Keywords

Permit ManagementConstruction ComplianceApplied AIOperations LeadershipCross-Functional Collaboration

About the role

Key responsibilities & impact

Own PermitFlow's core AI infrastructure and workflow agents
Deliver workflow agents for permitting, enabling comprehension of construction projects and accurate compliance submissions for permits and inspections
Define and own the quality bar for reliable permit submissions and release gating
Drive the path to full automation and single-shot submissions where accuracy allows
Design assistive workflows and human-in-the-loop agent tools for permit coordinators
Partner with operations on evaluation, early testing, golden data sets, structured error analysis, and the data flywheel
Build a design system enabling user feedback on Agents & AI products
Build internal tools for testing, error analysis, and hill climbing
Serve as the internal applied AI expert for teams from traditional software backgrounds
Collaborate with users, customers, operations, engineering, and cross-functional teams
Report directly to the Head of Product

Requirements

What you’ll need

7+ years of product management experience, or equivalent track record in forward deployed engineering, applied research, or operations leadership
Direct ownership of the quality bar for a shipped AI/Agentic system
Hands-on experience building evaluations, including golden data sets, LLM-as-judge, human annotation, and online monitoring
Judgment on when to build an agent versus a simpler product or process change
Deep technical fluency and comfort engaging engineering on technical concepts
Track record partnering closely with operations teams and translating operational insight into product
Ability to operate effectively in ambiguity and create clarity for cross-functional teams
High sense of ownership, urgency, and accountability
Track record of high-quality delivery and increased scope across multiple roles
Willingness to work hybrid from New York City or relocate
Authorization to work in the United States or ability to address employer sponsorship requirements

Benefits

Comp & perks

Competitive salary
Meaningful equity in a high-growth company
100% company-paid base medical, dental, and vision coverage for employees
Healthcare FSA
401(k) savings plan
Unlimited PTO
Paid family leave
Home office & equipment stipend
Daily in-office lunch and dinner provided
Commuter benefits (pre-tax transit and parking)