
Staff Software Engineer, Applied AI
Pearl Health
full-time
Posted on:
Location Type: Remote
Location: Massachusetts • New York • United States
Visit company websiteExplore more
Salary
💰 $180,000 - $240,000 per year
Job Level
Tech Stack
About the role
- Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization.
- Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience.
- Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability.
- Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features.
- Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2).
- Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization.
- Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization.
- Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development.
- Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain.
- Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product.
Requirements
- 8-12 years of experience in large-scale software engineering, with a proven track record in service-oriented architectures and large data systems.
- Demonstrated architectural experience designing and implementing highly observable, scalable distributed systems, including complex microservices and event-driven architectures.
- Hands-on experience in the full-stack productization of Applied AI/LLM features, specifically working with RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.
- Cloud platform proficiency (preferably AWS), including hands-on experience with infrastructure design, deployment pipelines, and cost optimization.
- Expertise in designing and optimizing data-intensive applications, including deep database expertise (schema design, query optimization) and data consistency patterns.
- A strong leadership track record in driving technical direction for significant, cross-functional projects.
Benefits
- Additional Compensation: This role is eligible for a discretionary performance bonus and equity options.
- Benefits: We offer a competitive benefits package. More on our careers page.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
LLM architectureRAGAgentsVector DBsdistributed systemsdata pipelinesAPIsmicroservicesApplied AIevent-driven architectures
Soft Skills
leadershipmentoringstrategic partnershiptechnical planningcommunication