The Leaflet

Analyst – AI Agent Operations

The Leaflet

full-time

Posted on:

Location Type: Remote

Location: Florida • United States

Visit company website

Explore more

✨ AI Apply
Apply

About the role

  • Collaborate with business stakeholders to identify opportunities where AI agents can improve efficiency, accuracy, and customer experience.
  • Gather, analyze, and document functional and non-functional requirements for AI agent use cases.
  • Translate business workflows and policies into AI agent logic, decision trees, prompts, and automation rules.
  • Analyze AI agent performance using qualitative feedback and quantitative metrics (e.g., accuracy, resolution rates, escalation rates, latency).
  • Monitor AI agent behavior to identify gaps, bias, errors, or unintended outcomes and recommend corrective actions.
  • Partner with engineering and data science teams to support AI agent development, testing, deployment, and iteration.
  • Define success metrics, KPIs, and reporting dashboards for AI agent effectiveness and business impact.
  • Ensure AI agents comply with regulatory, risk, and responsible gaming requirements.
  • Support UAT, validation, and post-launch monitoring of AI agent releases.
  • Document AI agent workflows, decision logic, escalation paths, and operational guidelines.
  • Work closely with Customer Operations, Fraud, Risk, and Compliance teams to align AI behavior with real-world processes.
  • Facilitate feedback loops between end users and technical teams to drive continuous improvement.
  • Stay current on emerging AI, automation, and agent-based technologies and recommend enhancements.
  • Proactively identify optimization opportunities to expand AI agent capabilities across the organization.

Requirements

  • Bachelor’s degree in Business, Information Systems, Data Analytics, Computer Science, or a related field.
  • Master’s degree in Data Science, AI, or a related discipline is a plus.
  • Experience in the Online Gaming Industry is a strong advantage.
  • 3–5+ years of experience in business analysis, data analysis, automation, or AI-related roles.
  • Demonstrated experience working with AI tools, intelligent automation, chatbots, or agent-based systems.
  • Strong understanding of business processes and how AI can augment or automate decision-making.
  • Ability to interpret data, model workflows, and translate insights into actionable recommendations.
  • Excellent written and verbal communication skills, with the ability to explain AI concepts to non-technical audiences.
  • Proven ability to manage multiple initiatives and adapt in a fast-paced environment.
  • Strong analytical, problem-solving, and critical-thinking skills.
  • Certifications: AI, Data, or Analytics certifications (e.g., AI fundamentals, data analytics, automation platforms) are preferred but not required.
Benefits
  • 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
AI agentsdata analysisautomationbusiness analysisdecision treesKPI definitionperformance analysisworkflow modelingUATquantitative metrics
Soft Skills
communication skillsproblem-solvingcritical thinkingcollaborationadaptabilityanalytical skillsfeedback facilitationdocumentationstakeholder engagementcontinuous improvement
Certifications
AI fundamentalsdata analyticsautomation certifications