Zip

Software Engineer, AI Foundation – Mid-Senior Level

Zip

full-time

Posted on:

Location Type: Hybrid

Location: San FranciscoCaliforniaUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $160,000 - $240,000 per year

Job Level

About the role

  • Design and build the core agentic platform powering Zip's AI products, including orchestration, memory, retrieval, and document processing infrastructure.
  • Own end-to-end delivery of platform capabilities — from architecture decisions through production — with real influence over how the broader engineering organization builds AI.
  • Partner closely with every product team at Zip to understand their needs, surface shared patterns, and ship reusable infrastructure that raises quality across Intake AI, Chatbot, IP Agent, Contract Orchestration, and Payments simultaneously.
  • Push the frontier of applied AI engineering: LLM orchestration with LangGraph, RAG pipelines, agentic document parsing, and self-correcting memory systems.
  • Build and evolve eval frameworks and observability tooling that make AI systems measurably more reliable over time.
  • Translate ambiguous, open-ended problems into well-scoped technical solutions, without waiting for a playbook that may not yet exist.

Requirements

  • We are hiring software engineers across all levels. Most of our open roles are targeting individuals with at least 3 years experience if past work is highly relevant
  • BS or higher, in Computer Science or related technical field involving coding (e.g. physics or math)
  • 3+ years of backend or full-stack software engineering experience in a production environment.
  • Strong Python proficiency; experience with async frameworks and distributed systems is a plus.
  • Hands-on experience building or operating LLM-based applications — RAG pipelines, tool use, agents, or eval systems.
  • Experience with data pipelines, job scheduling (Airflow or equivalent), and vector databases or embedding-based search.
  • Comfort with observability tooling: tracing, logging, metrics, and alerting in production AI systems.
  • A track record of owning problems end-to-end — you care whether things work in production, not just whether they shipped.
  • Ability to drive ambiguous, open-ended problems to a conclusion without a lot of hand-holding.
  • A platform mindset: you think about who else will use what you build and design for reuse, not just the immediate use case.
  • Exposure to AI-driven automation or interest in working with AI/ML teams to build intelligent workflows.
Benefits
  • Start-up equity
  • 100% health, vision & dental coverage options
  • Catered breakfast, lunch, & dinner
  • Flexible PTO
  • ClassPass membership
  • Monthly commuter benefit
  • Team building events & happy hours
  • Home office stipend
  • Phone/internet reimbursement
  • Paid parental leave
  • Fertility stipend
  • 401k plan
  • Unlimited AI token usage
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Pythonasync frameworksdistributed systemsLLM-based applicationsRAG pipelinesdata pipelinesjob schedulingvector databasesembedding-based searchobservability tooling
Soft Skills
problem ownershipdriving ambiguous problems to conclusionplatform mindset
Certifications
BS in Computer ScienceBS in related technical field