Software Engineer, Agent Dev Velocity

Notion

Software Engineer at Notion building scalable eval systems and tools for high-quality AI delivery. Collaborate with AI product and platform teams for efficient workflows.

Posted 5/13/2026full-timeSan Francisco • California • 🇺🇸 United StatesMid-LevelSenior💰 $214,000 - $300,000 per yearWebsite

Tech Stack

Tools & technologies

Node.jsPythonTypeScript

About the role

Key responsibilities & impact

Build and improve scalable eval runners and harnesses.
Make it easy for engineers to add high-signal evals.
Build and maintain benchmark and dataset tooling.
Improve reliability and observability for eval execution.
Partner closely with AI product, AI platform, and infrastructure teams.

Requirements

What you’ll need

Strong software engineering fundamentals and experience shipping production systems.
Proficiency with TypeScript/Node and/or Python.
Experience building reliable systems in distributed environments.
Comfort working with data pipelines.
Practical experience designing measurement or evaluation systems.
Curiosity to adopt AI tools to work smarter.

Benefits

Comp & perks

Competitive cash compensation
Equity
Benefits

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

TypeScriptNodePythonsoftware engineeringproduction systemsreliable systemsdistributed environmentsdata pipelinesmeasurement systemsevaluation systems

Soft Skills

curiositycollaboration