Zocdoc

Staff Software Engineer, AI

Zocdoc

full-time

Posted on:

Location Type: Hybrid

Location: New York City • New York • 🇺🇸 United States

Visit company website
AI Apply
Apply

Salary

💰 $180,000 - $270,000 per year

Job Level

Lead

Tech Stack

Distributed SystemsMicroservices

About the role

  • Architect, build, and maintain high-quality, scalable software systems that power Zocdoc’s AI Phone Assistant.
  • Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
  • Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
  • Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
  • Drive the evolution of our AI platform — from experimentation and rapid prototyping to scalable, reliable systems in production.
  • Ensure system scalability, observability, and performance as the product grows rapidly.
  • Stay ahead of the curve on emerging GenAI tools and technologies, and apply them to solve real-world user problems.

Requirements

  • 7+ years of professional software development experience, with at least 2+ years building or integrating AI/ML systems in production environments.
  • Strong proficiency in C#, and experience with distributed systems and microservices architectures.
  • Experience working with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces.
  • Proven ability to design, build, and scale complex, reliable, and high-performance systems.
  • A deep understanding of data structures, algorithms, and software design principles.
  • A track record of technical leadership and ownership over major systems or product areas.
  • Strong collaboration and communication skills — able to partner across disciplines to deliver results.
  • A passion for leveraging AI to build products that make a real difference in people’s lives
Benefits
  • Flexible, hybrid work environment
  • Unlimited PTO
  • 100% paid employee health benefit options
  • Employer funded 401(k) match
  • Corporate wellness programs with Headspace and Peloton
  • Sabbatical leave (for employees with 5+ years of service)
  • Competitive parental leave
  • Cell phone reimbursement
  • Great Place to Work Certified
  • Catered lunch everyday along with snacks
  • Commuter Benefits
  • Convenient Soho location

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
C#AI/ML systemslarge language models (LLMs)prompt engineeringconversational AIdistributed systemsmicroservices architecturesdata structuresalgorithmssoftware design principles
Soft skills
technical leadershipcollaborationcommunicationownershipproblem-solving
Zocdoc

Staff Software Engineer, Appointment Management

Zocdoc
Leadfull-time$180k–$270k / yearNew York · 🇺🇸 United States
Posted: 9 hours agoSource: boards.greenhouse.io
AWSJavaScriptMicroservicesNode.jsReactScala
Zocdoc

Staff Software Engineer – Scheduling

Zocdoc
Leadfull-time$180k–$270k / yearNew York · 🇺🇸 United States
Posted: 9 hours agoSource: boards.greenhouse.io
GEICO

Staff Engineer

GEICO
Leadfull-time$115k–$230k / yearMaryland, New York · 🇺🇸 United States
Posted: 12 hours agoSource: geico.wd1.myworkdayjobs.com
AWSAzureCloudDistributed SystemsDockerGoogle Cloud PlatformJavaJavaScriptKubernetesMicroservicesSpringSpring Boot+1 more
Xibo Open Source Digital Signage

Staff Software Engineer

Xibo Open Source Digital Signage
Leadfull-time$220k–$240k / yearCalifornia, New York · 🇺🇸 United States
Posted: 12 hours agoSource: sonyglobal.wd1.myworkdayjobs.com
AngularAnsibleAWSBabelCloudDockerEmber.jsGoJavaJavaScriptJenkinsJest+6 more