Staff AI Engineer – AI Infrastructure, Agentic Platform

ShiftKey

Staff AI Engineer managing AI infrastructure and agentic systems for ShiftKey's healthcare workforce platform. Collaborating with cross-functional teams to evolve AI capabilities and support customer-facing tools.

Posted 7/16/2026full-timeRemote • 🇺🇸 United StatesLeadWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in architecting and operating AI infrastructure on AWS, with a focus on retrieval engineering, multi-step reasoning, and cost governance. Proficient in building production-grade AI applications using modern programming languages and frameworks, while ensuring compliance with data-handling requirements.

Highest-signal resume keywords

AI Infrastructure ArchitectureRetrieval EngineeringProduction-Grade Software EngineeringAWS Bedrock ExperienceTerraform Proficiency

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringRetrieval EngineeringMulti-Step ReasoningGo ProgrammingPython ProgrammingTypeScript ProgrammingAI Workload ManagementTerraformObservability MetricsData Handling Compliance

Tools & Technologies

AWSAWS BedrockAzure AI FoundryHyDEAgentic Frameworks

Industry Keywords

HIPAA ComplianceSaaS EnvironmentHealthcare Experience

Tech Stack

Tools & technologies

AWSAzureCloudGoPythonTerraformTypeScript

About the role

Key responsibilities & impact

Evolving the AI knowledge platform - taking the retrieval, indexing, and synthesis layer (currently semantic RAG + re-ranking + HyDE) to an organization-wide platform serving both internal engineering tools and customer-facing capabilities.
Architecting and operating agentic infrastructure on AWS - multi-step, tool-using AI systems that plan, retrieve, and act on complex queries and operational events, with cost guardrails and observability built in from day one.
Designing and building graph-based, relationship-aware retrieval across the organization's data sources, enabling multi-hop queries and letting agents accumulate organizational knowledge over time. This is on our roadmap, not in production - you will define the approach.
Partnering with product engineering to define the AI platform API surface, translating infrastructure primitives into developer-ready abstractions.
Building reference agent implementations on the platform - operational-incident triage, customer support, and future agentic use cases - grounding each agent's reasoning in institutional knowledge.
Owning the AI infrastructure cost model: monitoring compute, model, and storage spend, flagging anomalies, and proposing guardrails to keep workloads within defined budgets.

Requirements

What you’ll need

7+ years of professional software engineering experience, with at least 2 years building and operating production AI/LLM application systems - not research, not prototyping, not demos.
Retrieval engineering beyond the basics. Our stack already includes re-ranking and HyDE; we need someone who has worked at or above that level: hybrid search, re-ranking, query transformation, context-window management, and evaluation of retrieval quality in production.
Working experience with agentic frameworks and multi-step reasoning loops - tool use, iteration control, cost governance, and model routing trade-offs.
Production-grade software engineering fluency (strict typing, testing, async/concurrency, modern toolchain) in Go, Python, or TypeScript, with the ability to ramp into another quickly.
Hands-on experience operating AI workloads on a managed cloud AI platform (AWS Bedrock or Azure AI Foundry), including the identity/secrets model and model access governance. Bedrock preferred given our AWS stack.
Hands-on Terraform experience - able to author and provision new infrastructure independently, not just modify existing modules.
Familiarity with production observability for AI systems: metrics, structured logging for model spend and latency, and evaluation harnesses to detect regressions.
Understanding of HIPAA-style data-handling requirements in a regulated SaaS environment. Prior healthcare experience is a plus, not a requirement.

Benefits

Comp & perks

Inclusive and collaborative work environment where all voices are valued.
Hybrid-friendly office spaces designed to be fun and engaging.
Comprehensive health, vision, and dental coverage.
Benefits begin on your first day.
Generous PTO and company-paid holidays, including flexible floating holidays.
100% 401(k) employer match up to 6%.
Paid parental leave.
Wellness support, including access to mental health resources.