Architect and scale the EisnerAI Platform on Azure, designing core data, application, and agentic layers to support growth toward 1,000+ AI agents
Codify AI governance policies (NIST AI RMF, PCAOB, Section 7216) into enforceable platform-level controls, automated compliance checks, and governance-as-code pipelines
Serve as a technical mentor and cross-functional leader, elevating AI platform capabilities across IT, AI Advisory, and engineering teams
Lead AI performance engineering across the firm’s LLM ecosystem — benchmarking models (GPT-4o, o3, etc.) for accuracy, latency, cost, and quality to drive model selection and routing strategy
Build and operate a real-time AI performance monitoring layer tracking hallucination rates, retrieval precision, adoption, cost-per-interaction, and ROI
Optimize prompts, model configurations, and routing strategies to maximize output quality while reducing token consumption and overall platform cost
Own AI cost management across Azure AI Foundry and related services, implementing intelligent model routing, caching, and token budgeting to continuously lower cost-per-agent
Ensure all AI deployments meet regulatory, risk, and firm data governance standards prior to production
Deliver executive and board-level dashboards translating AI performance, adoption, and cost metrics into clear business value narratives

Requirements

Bachelor's degree in Computer Science, Engineering, Data Science, or related technical field
8+ years of experience in cloud platform architecture, infrastructure engineering, or AI/ML platform development
5+ years of hands-on experience with Microsoft Azure services (AI Foundry, Azure OpenAI, Cosmos DB, ADLS, Purview, AI Search)
3+ years of experience benchmarking, evaluating, and optimizing LLM-based systems in production environments
Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa for this position now or in the future.

Benefits

flexibility to manage your days in support of our commitment to work/life balance
culture that has received multiple top “Places to Work” awards

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

cloud platform architectureinfrastructure engineeringAI/ML platform developmentbenchmarkingoptimizing LLM-based systemsAI governance policiescompliance checksmodel routing strategiesprompt optimizationcost management

Soft Skills

technical mentoringcross-functional leadership