Senior Engineering Manager, AI

AlphaSense

Senior Engineering Manager leading AlphaSense’s AI Gateway, which powers AI-driven market intelligence for enterprise customers. Managing engineers and scaling multi-vendor LLM infrastructure for speed, reliability, and cost.

Posted 8/5/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $275,000 - $375,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading high-performing engineering teams while driving the architecture and strategy of high-throughput, low-latency distributed systems. Proficient in fostering collaboration across engineering, product, and executive stakeholders to ensure alignment with business objectives.

Highest-signal resume keywords

Team ManagementHigh-Throughput Distributed SystemsArchitectural StrategyAI Tools IntegrationSoftware Engineering Best Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Distributed Systems DesignRoutingCachingQueueingPythonJavaAI Gateway ArchitectureToken-Based Cost TrackingLatency OptimizationMulti-Vendor Orchestration

Soft Skills

CommunicationMentoringCollaborationLeadershipPartnership

Tools & Technologies

LangChainLangGraphLiteLLMOpenRouterTemporalEnvoy

Industry Keywords

AI PlatformLLM VendorsTechnical ExcellencePredictable DeliveryCareer Growth

Tech Stack

Tools & technologies

Distributed SystemsJavaPython

About the role

Key responsibilities & impact

Lead the AI Platform team building and operating AlphaSense’s core AI Gateway
Manage, mentor, and grow a team of up to 10 senior and staff software engineers, mostly distributed across North America
Foster a high-performance culture of technical excellence, predictable delivery, and career growth
Own the strategy and architecture of the enterprise AI Gateway, processing up to 1 trillion LLM tokens per week
Ensure high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms
Guide integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models
Optimize multi-vendor orchestration for latency, cost, and reliability
Partner with product management, AI research teams, and executive engineering leads on the gateway roadmap
Define and champion software engineering best practices and architectural standards
Establish token-based cost-tracking telemetry across the AI Platform organization

Requirements

What you’ll need

Strong track record managing and growing high-performing teams of senior and staff engineers
Experience developing technical leaders and aligning engineering objectives with business strategy
Experience designing, building, and operating high-throughput, low-latency distributed systems
Experience with complex routing, caching, queueing, or rate limiting
Ability to engage in high-level architectural discussions and provide technical direction
Exceptional communication and partnership skills across engineering, product, and executive stakeholders
Active use of AI tools in developer workflows and an AI-first mindset
Experience in applied AI or with LangChain, LangGraph, LiteLLM, or OpenRouter is nice to have
Experience with Temporal, Envoy, or similar enterprise-grade gateway technologies is nice to have
Experience with Python, Java, and highly distributed caching/queueing systems is nice to have

Benefits

Comp & perks

Equity may be offered
Generous benefits program
AlphaSense never asks candidates to pay for job applications, equipment, or training