Salary
💰 $180,000 - $270,000 per year
Tech Stack
Distributed SystemsMicroservices
About the role
- Architect, build, and maintain high-quality, scalable software systems that power Zocdoc’s AI Phone Assistant.
- Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
- Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
- Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
- Drive the evolution of our AI platform — from experimentation and rapid prototyping to scalable, reliable systems in production.
- Ensure system scalability, observability, and performance as the product grows rapidly.
- Stay ahead of the curve on emerging GenAI tools and technologies, and apply them to solve real-world user problems.
Requirements
- 7+ years of professional software development experience, with at least 2+ years building or integrating AI/ML systems in production environments.
- Strong proficiency in C#, and experience with distributed systems and microservices architectures.
- Experience working with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces.
- Proven ability to design, build, and scale complex, reliable, and high-performance systems.
- A deep understanding of data structures, algorithms, and software design principles.
- A track record of technical leadership and ownership over major systems or product areas.
- Strong collaboration and communication skills — able to partner across disciplines to deliver results.
- A passion for leveraging AI to build products that make a real difference in people’s lives
- Flexible, hybrid work environment
- Unlimited PTO
- 100% paid employee health benefit options
- Employer funded 401(k) match
- Corporate wellness programs with Headspace and Peloton
- Sabbatical leave (for employees with 5+ years of service)
- Competitive parental leave
- Cell phone reimbursement
- Great Place to Work Certified
- Catered lunch everyday along with snacks
- Commuter Benefits
- Convenient Soho location
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
C#AI/ML systemslarge language models (LLMs)prompt engineeringconversational AIdistributed systemsmicroservices architecturesdata structuresalgorithmssoftware design principles
Soft skills
technical leadershipcollaborationcommunicationownershipproblem-solving