LLM Engineer

• Define product strategy and roadmap for GPU instances, clusters, and services
• Manage the entire product lifecycle from planning to end-of-life
• Develop and execute go-to-market strategies, messaging, and launch plans
• Collaborate with ecosystem partners on roadmap and technical needs
• Translate AI, HPC and graphics workload needs into specifications and performance goals
• Oversee GPU infrastructure lifecycle components and implement data-driven decisions
• Identify enhancements for proactive monitoring and support processes

Senior Product Manager, AI Infrastructure, GPU

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Senior Lead AI Engineer, FM Hosting, LLM Inference

• lead the product marketing strategy for Cisco’s AI infrastructure portfolio
• connect technical capabilities to the business outcomes customers require for AI workloads and AI-native applications
• define the narrative, positioning, messaging, launch strategy, and sales enablement required to power secure, connected, AI-ready organizations
• partner with Product Management, Engineering, Sales, Corporate Marketing, Analyst Relations, and Communications
• translate sophisticated infrastructure innovation into market value
• drive cross-functional alignment
• equip the business to win with enterprise buyers and executives

LLM Engineer jobs in Massachusetts

See all jobs on JobTailor

Senior Product Manager, AI Infrastructure, GPU

Senior Lead AI Engineer, FM Hosting, LLM Inference

Director of Product Marketing Strategy – AI Infrastructure