Senior Software Engineer, AI Infrastructure

NVIDIA

full-time

Posted on: 9/25/2025

Origin: • 🇺🇸 United States • California

✨ AI Apply

💰 $148,000 - $287,500 per year

Senior

Distributed SystemsJavaScriptKafkaKubernetesMicroservicesMongoDBNoSQLPythonRedisSQL

About the role

Build and maintain core infrastructure for deploying and running agents in production, powering agentic tools and applications and ensuring seamless and efficient performance
Design, develop, and improve scalable infrastructure to support the next generation of AI applications, including copilots and agentic tools
Drive improvements in architecture, performance, and reliability, enabling teams to bring to bear LLMs and advanced agent frameworks at scale
Collaborate closely with researchers, hardware, software, and research teams to design and scale agents and integrate solutions
Mentor and support peers, encouraging best engineering practices and a culture of technical excellence
Stay informed of the latest advancements in AI infrastructure and contribute to continuous innovation across the organization

Master or PhD or equivalent experience in Computer Science or related field
Minimum of 5 years in large-scale distributed systems or AI infrastructure
Advanced expertise in Python (required)
Strong experience with JavaScript
Deep knowledge of software engineering principles, OOP/functional programming, and writing high-performance, maintainable code
Demonstrated expertise in crafting scalable microservices, web apps, SQL, and NoSQL databases (especially MongoDB and Redis) in production with containers, Kubernetes, and CI/CD
Solid experience with distributed messaging systems (e.g., Kafka)
Experience integrating event-driven or decoupled architectures into robust enterprise solutions
Practical experience integrating and fine-tuning LLMs or agent frameworks (e.g., LangChain, LangGraph, AutoGen, OpenAI Functions, RAG, vector databases, timely engineering)
Demonstrated end-to-end ownership of engineering solutions, from architecture and development to deployment, integration, and ongoing operations/support
Excellent communication skills and a collaborative, proactive approach