Senior Engineering Manager, AI

AlphaSense

Senior Engineering Manager leading AI Platform team at AlphaSense. Overseeing high-throughput AI Gateway with a focus on team development and technical excellence.

Posted 7/22/2026full-timeRemote • New York • 🇺🇸 United StatesSenior💰 $361,200 - $496,800 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in strategic team leadership, fostering a high-performance culture, and managing enterprise-scale operations for AI systems. Proficient in technical governance and cross-functional alignment to drive engineering objectives and business strategy.

Highest-signal resume keywords

Engineering LeadershipEnterprise Scale ExperienceTechnical Thought LeadershipStrategic CommunicationModern Tooling & AI-First Mindset

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Distributed SystemsRoutingCachingQueueingRate LimitingPythonJavaArchitectural StandardsToken-Based Cost-TrackingAI Frameworks

Soft Skills

MentoringTeam GrowthHigh-Performance CulturePartnership Skills

Tools & Technologies

LangChainLangGraphLiteLLMOpenRouterTemporalEnvoy

Industry Keywords

AI GatewayLLM VendorsHigh-Throughput SystemsLow-Latency SystemsTechnical Governance

Tech Stack

Tools & technologies

Distributed SystemsJavaPython

About the role

Key responsibilities & impact

Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

Requirements

What you’ll need

Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.
Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.
Relevant Tech Stack Experience (Nice to Have): Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
Experience with Python, Java, and highly distributed caching/queueing systems.

Benefits

Comp & perks

You may also be offered equity
Generous benefits program