Senior AI Engineer – Grafana Ops, AI/ML

Grafana Labs

Senior AI Engineer developing observability tools that enhance user incident response and system understanding at Grafana Labs. Collaborating cross-functionally to deliver impactful AI-driven features and solutions.

Posted 5/26/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $127,651 - $203,867 per yearWebsite

Tech Stack

Tools & technologies

AWSAzureCloudGoogle Cloud Platform

About the role

Key responsibilities & impact

Build and deliver AI solutions: Take ownership of developing high-performance AI features to help users detect, triage, and resolve incidents using observability data and tools.
Rapid experimentation and iteration: Implement a highly iterative process where you quickly prototype, test, and validate with real users, including shipping and evolving LLM- or agent-powered workflows for incident lifecycle management and automated analysis tasks.
Collaborate cross-functionally: Work with data analysts, product managers, and designers to shape AI-driven product features, including integration of agentic components with internal tools, alerting systems, runbooks, and developer workflows.
Utilize AI tools effectively: Use AI and automation tools to enhance both product functionality and your own development workflows.
Effective communication: You’ll be working in a highly dynamic and collaborative environment, so we need someone who can communicate effectively and contribute across teams.
Ownership and impact: Take full ownership of the AI solutions you develop, ensuring they are not only innovative but also scalable, maintainable, and aligned with real user workflows.

Requirements

What you’ll need

Experience with LLMs, prompt engineering, and building applications powered by GenAI.
Proven track record of delivering software that made it into production and is actively used by users.
Exposure to working in cloud-native environments (e.g., AWS, GCP, Azure).
Experience using observability tools to understand and troubleshoot system behavior.

Benefits

Comp & perks

Equity
Bonus (if applicable)
Restricted Stock Units (RSUs)
Annual leave policy of 30 days per annum
In-Person onboarding

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

AI solutions developmentLLMsprompt engineeringGenAI applicationssoftware deliverycloud-native environmentsobservability toolsincident lifecycle managementautomated analysisprototyping

Soft Skills

effective communicationcollaborationownershipimpactiterationproblem-solvingcross-functional teamworkuser validationadaptabilityinnovation