Senior Product Data Scientist
BetterUp
PythonSQL
Applied Scientist, AI
Marshmallow
full-time
Posted on:
Origin: • 🇬🇧 United Kingdom
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
SQL
About the role
- Lead the design, development, and implementation of customer-facing AI agent solutions
- Develop and refine conversational AI models to achieve human-equivalent performance in complex customer interactions
- Establish and maintain robust evaluation frameworks and monitoring systems to ensure AI quality, compliance, and regulatory standards
- Drive experimentation and iterative improvement cycles to enhance AI agent capabilities and customer experience
- Own the end-to-end lifecycle of AI agent deployments, including prompt design, context management, and troubleshooting to optimise conversational flow
- Collaborate closely with cross-functional teams across Product, Operations, Finance, and senior leadership, acting as a technical bridge
Requirements
- Proven experience working with customer-facing generative AI or conversational AI solutions
- Strong background in data science with hands-on experience deploying and evaluating machine learning or AI models, particularly large language models (LLMs)
- Deep understanding of prompt engineering, LLM evaluation, and agentic AI systems
- Experience working with or integrating third-party AI platforms (e.g., Sierra) and collaborating with external technology partners
- Solid SQL skills for data querying and analysis to support model evaluation and experimentation frameworks
- Excellent communication skills with the ability to translate complex technical concepts to non-technical stakeholders and senior leadership
- Comfortable navigating ambiguity and designing thoughtful experimentation frameworks to iterate and improve AI-driven customer journeys
