LLM Engineer

• Design and build the infrastructure layer powering AI agent systems in production
• Develop high-performance Rust services that handle model inference, orchestration, and execution
• Architect scalable systems capable of supporting millions of users and high request throughput
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
• Define guardrails, observability, and failure handling for agent-driven workflows
• Optimize latency, throughput, and cost across inference and orchestration layers
• Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems
• Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

Senior Software Engineer – AI Infrastructure

• Design end-to-end AI solutions on Dataiku's platform, leveraging Dataiku Agent Hub, Prompt Studio, LLM Mesh, and Knowledge Banks (Vector Stores), or Python-based frameworks where needed.
• Build and orchestrate multi-agent systems using Dataiku's Visual Agents (simple and structured), as well as code-based frameworks (LangGraph, CrewAI, Claude Agent SDK, OpenAI Agents SDK) as appropriate.
• Integrate and optimize LLM APIs across providers (OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure, open-source models via Dataiku's LLM Mesh), applying model routing strategies to balance cost, latency, and quality.
• Implement Retrieval-Augmented Generation (RAG) pipelines, including agentic RAG and GraphRAG, using Dataiku's Knowledge Banks with reranking, dynamic filtering, and document extraction capabilities.
• Work primarily with the “Revenue” organisation, Sales, BDR, Customer Success, Solutions Engineering, Professional Services, Sales Operations and Marketing (approximately 75% of the role), and apply proven solutions and approaches more broadly across the organisation (approximately 25%).
• Engage stakeholders to gather business requirements, then go further: identify the underlying user pain those requirements represent, and design solutions that address both the stated need and the deeper problem.
• Own projects end-to-end, from requirements intake and solution design through to build, deployment, and handover.
• Develop autonomous and semi-autonomous AI agents, using Dataiku's Agent Builder, custom Python-based architectures (LangGraph, CrewAI, Claude Agent SDK, etc.), or a combination of both. Exercise judgment on when to leverage platform capabilities and when to build custom solutions.
• Design and build Agent Tools beyond documented examples, including custom API integrations, data retrieval modules, decisioning logic, and automated workflows, pushing past out-of-the-box patterns to deliver solutions tailored to specific business problems.
• Build, publish, and consume MCP (Model Context Protocol) servers to enable agent-to-tool integration across systems, including designing custom MCP servers where needed.
• Develop evaluation and monitoring approaches for agent systems, combining Dataiku's built-in capabilities with custom instrumentation to measure reliability, accuracy, cost, and business impact in production.
• Design and maintain evaluation frameworks (evals) for LLM-based systems, measuring accuracy, latency, cost, and reliability in production.
• Adhere to data governance, security, and regulatory compliance requirements (EU AI Act awareness, responsible AI practices) for all AI solutions.
• Leverage Dataiku's Cost Guard and Quality Guard features to manage LLM spend, enforce usage policies, and maintain output quality standards.
• Work closely with analytics and data engineering teams to maintain metadata on reference datasets for LLM consumption.
• Create front-end user interfaces for AI applications using HTML, CSS, and JavaScript, within Dataiku's webapps framework, Dataiku Answers for chat-based interfaces, or standalone applications built with Vue.js and Node.js.
• Collaborate on UX design, ensuring internal stakeholders find AI solutions intuitive and responsive.
• Provide product feedback to the development team to improve the platform.
• Stay current with the rapidly evolving AI engineering landscape, agent frameworks, model capabilities, evaluation practices, governance requirements, and tools like MCP and A2A protocols.

Generative AI Engineer

• Create innovative, thought provoking, and highly leveraged “must-have insight” content
• Develop new insights and ideas through thought leadership
• Research, analyze and predict market trends
• Provide clients and prospects with actionable advice
• Create and deliver high value presentation materials
• Support BTI and Sales
• Build credibility as an industry expert
• Identify research process improvements.
• Be a mentor and coach by supporting more junior team members.

See all jobs on JobTailor

Senior Software Engineer – AI Infrastructure

Generative AI Engineer

VP Analyst, AI Infrastructure – Heads of I&O