
Software Engineer, AI Foundation – Mid-Senior Level
Zip
full-time
Posted on:
Location Type: Hybrid
Location: San Francisco • California • United States
Visit company websiteExplore more
Salary
💰 $160,000 - $240,000 per year
Job Level
Tech Stack
About the role
- Design and build the core agentic platform powering Zip's AI products, including orchestration, memory, retrieval, and document processing infrastructure.
- Own end-to-end delivery of platform capabilities — from architecture decisions through production — with real influence over how the broader engineering organization builds AI.
- Partner closely with every product team at Zip to understand their needs, surface shared patterns, and ship reusable infrastructure that raises quality across Intake AI, Chatbot, IP Agent, Contract Orchestration, and Payments simultaneously.
- Push the frontier of applied AI engineering: LLM orchestration with LangGraph, RAG pipelines, agentic document parsing, and self-correcting memory systems.
- Build and evolve eval frameworks and observability tooling that make AI systems measurably more reliable over time.
- Translate ambiguous, open-ended problems into well-scoped technical solutions, without waiting for a playbook that may not yet exist.
Requirements
- We are hiring software engineers across all levels. Most of our open roles are targeting individuals with at least 3 years experience if past work is highly relevant
- BS or higher, in Computer Science or related technical field involving coding (e.g. physics or math)
- 3+ years of backend or full-stack software engineering experience in a production environment.
- Strong Python proficiency; experience with async frameworks and distributed systems is a plus.
- Hands-on experience building or operating LLM-based applications — RAG pipelines, tool use, agents, or eval systems.
- Experience with data pipelines, job scheduling (Airflow or equivalent), and vector databases or embedding-based search.
- Comfort with observability tooling: tracing, logging, metrics, and alerting in production AI systems.
- A track record of owning problems end-to-end — you care whether things work in production, not just whether they shipped.
- Ability to drive ambiguous, open-ended problems to a conclusion without a lot of hand-holding.
- A platform mindset: you think about who else will use what you build and design for reuse, not just the immediate use case.
- Exposure to AI-driven automation or interest in working with AI/ML teams to build intelligent workflows.
Benefits
- Start-up equity
- 100% health, vision & dental coverage options
- Catered breakfast, lunch, & dinner
- Flexible PTO
- ClassPass membership
- Monthly commuter benefit
- Team building events & happy hours
- Home office stipend
- Phone/internet reimbursement
- Paid parental leave
- Fertility stipend
- 401k plan
- Unlimited AI token usage
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Pythonasync frameworksdistributed systemsLLM-based applicationsRAG pipelinesdata pipelinesjob schedulingvector databasesembedding-based searchobservability tooling
Soft Skills
problem ownershipdriving ambiguous problems to conclusionplatform mindset
Certifications
BS in Computer ScienceBS in related technical field