Build agentic AI infrastructure at Cohere from a remote position open to people in Canada, combining distributed systems and ML intuition. As a Staff or Senior Staff Software Engineer, you will create platforms powering autonomous AI agents at scale. The work spans ML systems, distributed infrastructure, developer experience, and production-ready infrastructure. Cohere develops foundation models and enterprise AI products for real-world business problems. Key Responsibilities:
Build secure execution environments for agent-generated code Design identity, authentication, and trust boundaries for agents Develop model routing across model types and environments Manage quotas, rate limits, and agent workflow resources Create state, memory, and filesystem abstractions Requirements:
Build production ML infrastructure with robust systems fundamentals Work with agentic systems or multi-agent workflows Understand LLM provider frameworks and model routing Build scalable distributed systems and use Kubernetes Move quickly from prototypes toward productionization Bring systems depth and ML intuition to Cohere’s agent infrastructure, spanning execution, orchestration, security, and state management.