Pearl Health

Staff Software Engineer, Applied AI

Pearl Health

full-time

Posted on:

Location Type: Remote

Location: MassachusettsNew YorkUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $180,000 - $240,000 per year

Job Level

About the role

  • Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization.
  • Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience.
  • Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability.
  • Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features.
  • Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2).
  • Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization.
  • Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization.
  • Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development.
  • Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain.
  • Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product.

Requirements

  • 8-12 years of experience in large-scale software engineering, with a proven track record in service-oriented architectures and large data systems.
  • Demonstrated architectural experience designing and implementing highly observable, scalable distributed systems, including complex microservices and event-driven architectures.
  • Hands-on experience in the full-stack productization of Applied AI/LLM features, specifically working with RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.
  • Cloud platform proficiency (preferably AWS), including hands-on experience with infrastructure design, deployment pipelines, and cost optimization.
  • Expertise in designing and optimizing data-intensive applications, including deep database expertise (schema design, query optimization) and data consistency patterns.
  • A strong leadership track record in driving technical direction for significant, cross-functional projects.
Benefits
  • Additional Compensation: This role is eligible for a discretionary performance bonus and equity options.
  • Benefits: We offer a competitive benefits package. More on our careers page.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
LLM architectureRAGAgentsVector DBsdistributed systemsdata pipelinesAPIsmicroservicesApplied AIevent-driven architectures
Soft Skills
leadershipmentoringstrategic partnershiptechnical planningcommunication