Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition in a remote-friendly environment. Shape platforms for autonomous agents at scale. As a Senior Staff Software Engineer, you will create infrastructure spanning machine learning systems, distributed infrastructure, and developer experience. You will support secure execution, agent state management, model routing, and resource management. The work connects emerging research with reliable production platforms.

Key Responsibilities

Build secure execution environments for agent-generated code Design identity, authentication,



and trust boundaries for agents Develop model routing across model types and environments Manage quotas and resources for long-running agent workflows Create state, memory, and filesystem abstractions

Requirements:

Production machine learning infrastructure experience Robust systems fundamentals and distributed systems experience Hands-on agentic systems or multi-agent workflow experience Familiarity with model routing and LLM provider frameworks Experience with Kubernetes and fault-tolerant systems Apply systems depth and machine learning understanding to build secure, scalable agent infrastructure at Cohere for future AI systems.

#J-18808-Ljbffr

📌 Senior Agent Infrastructure Engineer (Toronto)
🏢 Avenue.io
📍 Toronto