Cohere

Senior Software Engineer, Agent Infrastructure

Cohere

full-time

Posted on:

Location Type: Remote

Location: Canada

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

Distributed SystemsKubernetes

About the role

  • Turn emerging ML research ideas into production-ready infrastructure
  • Build core platform capabilities for execution, storage, and state management
  • Prototype and evaluate new technologies, then help decide what should move into production
  • Partner with research teams to shape infrastructure based on what future agent systems will need

Requirements

  • Experience building production ML infrastructure with strong systems fundamentals
  • Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks
  • Familiarity with model routing and LLM provider frameworks across different model types and environments
  • Experience with scalable, fault-tolerant distributed systems and Kubernetes
  • A track record of moving quickly on prototypes and making good decisions about productionization.
  • If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!
Benefits
  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
machine learning infrastructuresystems fundamentalsagentic systemsmulti-agent workflowsagent development frameworksmodel routingLLM provider frameworksscalable systemsfault-tolerant systemsKubernetes
Soft Skills
decision makingprototypingcollaboration