Senior AI Technical Product Manager

Brillio

Lead a team of engineers and data scientists as Senior Product Manager in AI & Data Engineering firm. Prioritize projects, manage stakeholder relations, and guide technology roadmap.

Posted 4/13/2026full-timeRemote • New York • 🇺🇸 United StatesSenior💰 $160,000 - $170,000 per yearWebsite

Tech Stack

Tools & technologies

AzureCloudPython

About the role

Key responsibilities & impact

Lead a team of engineers, researchers, and data scientists, performing QA on AI agent outputs
Evaluate RAG pipeline architectures, challenge prompt engineering decisions, and review system designs
Build relationships with internal business teams, understanding workflows and translating pain points into actionable technical work
Set priorities and decide what the team works on across both AI Enablement and AI Experiments tracks
Serve as the primary liaison with internal business teams, gather requirements, and validate priorities
Communicate progress clearly to leadership and identify new internal processes where AI could reduce effort
Guide the team’s technology roadmap, evaluate architecture decisions and optimize AI infrastructure spend

Requirements

What you’ll need

8+ years of experience in technical product management, engineering management, or a similar role where you’ve led technical teams building AI/ML or data-driven products
Strong understanding of LLM-based systems you know how RAG pipelines work (retrieval, embedding, re-ranking, context window management), how prompt engineering affects output quality, and how agent orchestration patterns handle multi-step workflows.
Comfortable with Python you can read Python code, understand what it does, review pull requests for logic and architecture (not just style), and write quick scripts when needed to test an idea or validate data.
Familiar with Azure cloud infrastructure you understand how AI workloads are deployed, monitored, and scaled in Azure (or equivalent cloud platforms). You can have an informed conversation about compute costs, model serving, and infrastructure architecture.
You understand the cost structure of LLM-based systems token economics, model pricing tiers, the cost implications of different prompt lengths, caching strategies, and model routing approaches. You can optimize AI spend at a technical level, not just a budget level.
You can evaluate AI outputs critically you know what a hallucination looks like, you understand why an agent might produce inconsistent results, and you can diagnose whether the issue is in the prompt, the retrieval layer, the model choice, or the data.

Benefits

Comp & perks

🌐 Worldwide Post a Job Affiliates ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs Account Brillio Website LinkedIn All Job Openings 1001 - 5000 employees 🤖 Artificial Intelligence 🔒 Cybersecurity 💰 Private Equity Round on 2019-01 Artificial Intelligence
Consulting
Cybersecurity Brillio is a technology consulting company that specializes in driving digital transformation for businesses across various industries such as banking, financial services, insurance, life sciences, telecom and media, healthcare, and retail. They focus on customer experience transformation, data and AI, product and platform engineering, and provide infrastructure, cloud, and security solutions. With an emphasis on engineering digital products and leveraging generative AI, Brillio aims to provide bespoke solutions that help businesses thrive in the age of AI and technological disruption. They also offer services to help businesses adapt to new technological challenges and turn disruptions into competitive advantages. Senior AI Technical Product Manager 🔥 3 minutes ago 🗽 New York – Remote 💵 $160k - $170k / year ⏰ Full Time 🟠 Senior ⚒️ Technical Product Manager (TPM) 🦅 H1B Visa Sponsor Apply Now Find Hiring Managers Customize resume for this job ☆ Save ☑️ Mark as applied ❌ Hide Report problem 📋 Description
Lead a team of engineers, researchers, and data scientists, performing QA on AI agent outputs
Evaluate RAG pipeline architectures, challenge prompt engineering decisions, and review system designs
Build relationships with internal business teams, understanding workflows and translating pain points into actionable technical work
Set priorities and decide what the team works on across both AI Enablement and AI Experiments tracks
Serve as the primary liaison with internal business teams, gather requirements, and validate priorities
Communicate progress clearly to leadership and identify new internal processes where AI could reduce effort
Guide the team’s technology roadmap, evaluate architecture decisions and optimize AI infrastructure spend 🎯 Requirements
8+ years of experience in technical product management, engineering management, or a similar role where you’ve led technical teams building AI/ML or data-driven products
Strong understanding of LLM-based systems you know how RAG pipelines work (retrieval, embedding, re-ranking, context window management), how prompt engineering affects output quality, and how agent orchestration patterns handle multi-step workflows.
Comfortable with Python you can read Python code, understand what it does, review pull requests for logic and architecture (not just style), and write quick scripts when needed to test an idea or validate data.
Familiar with Azure cloud infrastructure you understand how AI workloads are deployed, monitored, and scaled in Azure (or equivalent cloud platforms). You can have an informed conversation about compute costs, model serving, and infrastructure architecture.
You understand the cost structure of LLM-based systems token economics, model pricing tiers, the cost implications of different prompt lengths, caching strategies, and model routing approaches. You can optimize AI spend at a technical level, not just a budget level.
You can evaluate AI outputs critically you know what a hallucination looks like, you understand why an agent might produce inconsistent results, and you can diagnose whether the issue is in the prompt, the retrieval layer, the model choice, or the data. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Engineering Manager – Technical Product Owners 🔥 24 minutes ago Cotiviti 5001 - 10000 ⚕️ Healthcare Insurance 💳 Fintech 🤖 Artificial Intelligence Website LinkedIn All Job Openings Software Development Manager leading development teams to improve outcomes for healthcare insurance members. Focus on strategic leadership and long-term software architecture alignment with business needs. 🇺🇸 United States – Remote 💵 $130k - $165k / year ⏰ Full Time 🟠 Senior 🔴 Lead ⚒️ Technical Product Manager (TPM) 🦅 H1B Visa Sponsor Technical Product Manager 🔥 5 hours ago Rise8 51 - 200 🏛️ Government Website LinkedIn All Job Openings Technical Product Manager focusing on DevSecOps and digital transformation for government organizations. Collaborating with OSS communities to optimize product delivery and client success while ensuring technical execution and mission impact. 🇺🇸 United States – Remote ⏰ Full Time 🟡 Mid-level 🟠 Senior ⚒️ Technical Product Manager (TPM) Technical Product Owner – AI-Native Product Lead 🕒 2 days ago Cotiviti 5001 - 10000 ⚕️ Healthcare Insurance 💳 Fintech 🤖 Artificial Intelligence Website LinkedIn All Job Openings AI-Native Product Lead managing product backlog and requirements for AI-assisted software development. Collaborating with engineers to produce valuable and high-quality software. 🇺🇸 United States – Remote 💵 $90k - $124k / year ⏰ Full Time 🟠 Senior ⚒️ Technical Product Manager (TPM) 🦅 H1B Visa Sponsor Technical Product Manager, Ratings – Lead Integrations 🕒 3 days ago The Baldwin Group 1001 - 5000 💸 Finance 🤝 B2B Website LinkedIn All Job Openings Technical Product Manager overseeing complex insurance rating engine and lead management platform. Collaborating with teams on product strategy, technical specifications, and partner integrations. 🇺🇸 United States – Remote 💰 $170M Post IPO debt on 2023-10 ⏰ Full Time 🟠 Senior ⚒️ Technical Product Manager (TPM) Senior Staff Technical Product Manager, AI Sim 🕒 4 days ago SandboxAQ 51 - 200 🤖 Artificial Intelligence 🔒 Cybersecurity 💊 Pharmaceuticals Website LinkedIn All Job Openings Product Manager driving product-led growth in the AI Simulation division of SandboxAQ. Defining complex capabilities and aligning cross-functional teams for product delivery. 🇺🇸 United States – Remote 💵 $159.2k - $306k / year ⏰ Full Time 🟠 Senior ⚒️ Technical Product Manager (TPM) View More Technical Product Manager Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

technical product managementengineering managementAI/ML product developmentRAG pipeline architectureprompt engineeringPythonAzure cloud infrastructureAI workload deploymentcost optimizationAI output evaluation

Soft Skills

team leadershiprelationship buildingcommunicationprioritizationrequirement gatheringprocess identificationtechnical translationcritical evaluation