Design and improve LLM-powered pipelines and agent architectures
Build robust evaluation and benchmarking frameworks to measure output quality and regression
Optimize for latency, cost, determinism, and output quality across high daily volume
Implement retrieval-augmented generation (RAG) and tool-use strategies where appropriate
Ship production-grade AI systems – not experiments
Collaborate closely with backend and product teams to integrate AI capabilities into the core platform

Requirements

5+ years of professional software engineering experience
Hands-on experience building and shipping LLM-powered applications in production
Deep familiarity with LLM concepts: prompt engineering, structured extraction, function/tool calling, RAG, evaluation frameworks
Experience with AWS or comparable cloud infrastructure for AI workloads
Strong software engineering fundamentals – you write clean, maintainable systems, not just notebooks

Benefits

401(k) Retirement Savings Plan
Equity Compensation
Dinner Provided via DoorDash & stocked kitchen for NY employees
Medical, Dental, and Vision coverage coverage of up to 100% premiums for you and your family
HSA / FSA
11 paid holidays each year
Unlimited PTO
Training and professional development
Hybrid Work Schedule (4 days onsite, 3 if located > 1 hour away)

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

LLM-powered applicationsprompt engineeringstructured extractionfunction callingretrieval-augmented generationevaluation frameworkssoftware engineering fundamentalsclean codemaintainable systems

Soft Skills

collaborationcommunication