Software Architect

Harbor IT

Software Architect at Harbor Compliance defining and modernizing technical architecture for entity compliance platform. Leading AI-driven design and architecture for scalable systems.

Posted 6/20/2026full-timeRemote • 🇺🇸 United StatesSeniorLeadWebsite

Tech Stack

Tools & technologies

CloudDistributed SystemsMicroservices

About the role

Key responsibilities & impact

Define and maintain the technical architecture, establishing pragmatic patterns and guardrails that accelerate rapid, high-quality feature delivery.
Lead the technical execution for migrating, decoupling, and modernizing legacy systems, owning the sequencing, risk mitigation strategies, and target-state designs to extract core business domains seamlessly.
Establish the core shared framework for integrating agentic workflows, intelligent automation, and LLM orchestration across the platform with strict compliance auditability and AI API latency under 100 ms.
Act as the definitive technical authority to proactively resolve cross-team architectural dependencies and ensure alignment across infrastructure and codebases.
Collaborate with Product leadership and the VP of Engineering to translate business milestones into an actionable technical roadmap, grounding technical debt reduction directly in business outcomes.
Author and embed standardized design templates into the software development lifecycle that leverage AI-assisted tools, driving 100% adoption across engineering pods and reducing cycle times by 35% or more.
Work closely with development, QA, and security teams to ensure architectural blueprints are highly practical, realistic, and friction-free for execution.
Design and implement LLM routing, caching, and model-governance architectures that optimize AI infrastructure costs to remain within 10% of the quarterly budget.

Requirements

What you’ll need

10 or more years of software engineering experience, including 4 or more years in a dedicated architecture or principal/staff engineer role.
Proven track record leading large-scale legacy modernization, including defining target-state architecture, sequencing domain decoupling, and executing migrations with zero unplanned downtime.
Demonstrated experience architecting production-level AI/ML systems, including LLM orchestration, agentic workflows, or intelligent automation at scale.
Deep expertise in modern distributed systems architecture, microservices, event-driven design, API gateway patterns, and cloud-native infrastructure.
Hands-on experience designing and governing AI/ML platform infrastructure, including LLM routing, prompt engineering patterns, vector databases, model evaluation frameworks, and cost optimization strategies.
Strong command of cloud infrastructure, CI/CD pipeline architecture, automated testing frameworks, and enterprise SaaS security and compliance requirements.
Experience partnering with VP and C-suite stakeholders to translate business strategy into technical roadmaps and smart investment decisions.

Benefits

Comp & perks

health benefits
flexible paid time off
parental leave
fertility and adoption assistance
401(k)
educational reimbursement

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

software engineeringarchitecturelegacy modernizationAI/ML systemsdistributed systems architecturemicroservicesevent-driven designAPI gateway patternscloud-native infrastructurecost optimization strategies

Soft Skills

leadershipcollaborationcommunicationproblem-solvingstrategic thinkingrisk mitigationtechnical authoritystakeholder engagementroadmap developmentstandardization