AI Platform Software Engineer

. Support and scale adoption of the enterprise AI platform by troubleshooting AI behavior .

Posted 5/13/2026full-timeRemote • Connecticut, Florida, Massachusetts • 🇺🇸 United StatesMid-LevelSenior💰 $65,000 - $85,000 per yearWebsite

Tools & technologies

AzureSQL

Key responsibilities & impact

Support and scale adoption of the enterprise AI platform by troubleshooting AI behavior
Identify systemic gaps and drive continuous improvement in platform performance and usage
Work directly with internal associates to resolve issues
Partner closely with engineering teams to diagnose root causes across LLMs, agent workflows, tools (MCP), and backend systems
Investigate and resolve issues reported by users of Agent Assist
Reproduce issues and trace failures across LLM responses, agent workflows, and orchestration
Analyze logs, traces, and telemetry (e.g., Langfuse, NewRelic logs)
Document findings and partner with engineering on resolution leveraging Azure DevOps
Identify issues stemming from prompting, retrieval (RAG), tool selection, or backend systems
Propose improvements to agents, skills, prompts, and workflows
Train internal users on how to effectively use Agent Assist
Run targeted demos, onboarding sessions, and office hours
Act as a trusted advisor to client-facing associates

What you’ll need

Up to 3 years’ experience in a technical support, QA, SDET, or engineering-adjacent role (including internships, co-ops, or academic projects)
Bachelor’s degree in Computer Science, Computer Information Systems, Business Information Systems, or a related technical field
Demonstrated ability to troubleshoot and debug technical issues, focusing on root cause analysis
Foundational experience or exposure to: API testing (Postman or similar)
Reading logs and debugging application behavior
Basic SQL or data inspection
Exposure to or strong interest in AI/LLM-based systems (prompting, chatbots, RAG, or agents) through coursework, projects, or hands-on experimentation
Experience using or willingness to learn AI-powered development tools (e.g., Cursor, Claude Code)
Strong communication skills with the ability to translate technical issues into clear explanations for non-technical users
Demonstrated curiosity and ability to learn quickly in a fast-evolving technical environment.

Comp & perks

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

troubleshootingroot cause analysisAPI testingSQLdata inspectiondebuggingAI systemsLLMpromptingRAG

Soft Skills

communicationcuriositylearning abilityproblem-solvingcollaborationadaptabilityuser trainingdocumentationclient advisorypresentation