GroupBy Inc.

AI Product Manager

GroupBy Inc.

full-time

Posted on:

Location Type: Hybrid

Location: London • United Kingdom

Visit company website

Explore more

✨ AI Apply
Apply

About the role

  • Own the evolution of AI capabilities within Conversational Commerce.
  • Define how conversational and agentic AI translate into differentiated customer value.
  • Partner with the Principal PM to shape roadmap priorities, sequencing, and trade-offs.
  • Own the AI evaluation strategy, including:
  • Success metrics
  • Experiments and analysis
  • Tying model performance to user and business outcomes
  • Define and track core AI quality metrics (e.g. task success, hallucinations, latency).
  • Own go / no-go decisions for AI changes (ship, rollback, iterate).
  • Clearly communicate impact, risk, and trade-offs to Product, Engineering, and Leadership.
  • Own LLM safety testing
  • Define and evolve guardrails to ensure safe, reliable AI behaviour.
  • Partner with engineering on grounding strategies, constraints, fallbacks, and escalation paths.
  • Contribute to decisions on how LLMs are deployed across conversational flows.
  • Help shape the Conversational Commerce multi-agent framework, including:
  • Agent roles and responsibilities
  • Orchestration and task decomposition
  • Tool usage boundaries
  • Lead continuous discovery through customer research, usage analysis, and feedback loops.
  • Validate that AI capabilities solve real, high-impact customer problems.
  • Translate AI strategy into clear requirements, roadmaps, and prioritized backlogs.
  • Enable fast execution without compromising quality or trust.

Requirements

  • 4–7+ years in Product Management, Applied AI, or ML-adjacent roles
  • Hands-on experience shipping LLM-powered systems in production.
  • Strong understanding of LLM failure modes, evaluation techniques, and mitigation strategies.
  • Comfortable making trade-offs across capability, cost, latency, and risk.
  • Clear, confident communicator across technical and non-technical teams.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AI capabilitiesConversational CommerceLLM-powered systemsevaluation techniquessuccess metricsAI quality metricsrisk assessmentcustomer researchtask decompositionfeedback loops
Soft Skills
clear communicationconfident communicationcollaborationdecision-makingtrade-off analysisleadershipcustomer-centric mindsetproblem-solvingadaptabilitystrategic thinking