Build agentic AI infrastructure at Cohere from a remote position open to people in Canada, combining distributed systems and ML intuition.
As a Staff or Senior Staff Software Engineer, you will create platforms powering autonomous AI agents at scale. The work spans ML systems, distributed infrastructure, developer experience, and production-ready infrastructure. Cohere develops foundation models and enterprise AI products for real-world business problems.
Key Responsibilities:
- Build secure execution environments for agent-generated code
- Design identity, authentication, and trust boundaries for agents
- Develop model routing across model types and environments
- Manage quotas, rate limits, and agent workflow resources
- Create state, memory, and filesystem abstractions
Requirements:
- Build production ML infrastructure with robust systems fundamentals
- Work with agentic systems or multi-agent workflows
- Understand LLM provider frameworks and model routing
- Build scalable distributed systems and use Kubernetes
- Move quickly from prototypes toward productionization
Bring systems depth and ML intuition to Cohere’s agent infrastructure, spanning execution, orchestration, security, and state management.