Software Engineer, AgentOps
Fieldguide
full-time
Posted on:
Location Type: Hybrid
Location: San Francisco • California • United States
Visit company websiteExplore more
Salary
💰 $160,000 - $310,000 per year
About the role
- Build and maintain the internal platform that makes agentic workflows reliable and easy to adopt for our team members.
- Make the right way to use AI the easy way for all team members.
- Build the instrumentation to track efficiency metrics, agent effectiveness, and team productivity.
- Run structured trials of new tools, synthesize learnings, and maintain a living point of view that the team can follow.
- Trainings, office hours, internal demos, and coaching that raise the floor across the org.
Requirements
- You are an excellent engineer first.
- Deep, hands-on experience with AI coding tools.
- Systems thinking.
- Ability to influence without authority.
- Bias toward measurement.
- Platform engineering or developer experience background
- Experience with LLMOps practices: eval frameworks, prompt regression testing, cost/performance tracking
- Track record rolling out internal tools across teams
- Security and compliance familiarity for AI-enabled workflows
- Experience building knowledge systems: search, RAG, internal documentation platforms
Benefits
- Competitive compensation packages with meaningful ownership
- Flexible PTO
- 401k
- Wellness benefits, including a bundle of free therapy sessions
- Technology & Work from Home reimbursement
- Flexible work schedules
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI coding toolsLLMOps practiceseval frameworksprompt regression testingcost trackingperformance trackingplatform engineeringknowledge systemssearch systemsinternal documentation platforms
Soft Skills
systems thinkinginfluence without authoritybias toward measurementcoachingtrainingcommunicationteam collaborationadaptabilityproblem-solvingleadership