Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition in a remote-friendly setting. Shape platforms for autonomous agents at scale.As a Senior Staff Software Engineer, you will create infrastructure spanning machine learning systems, distributed infrastructure, and developer experience. You will support secure execution, agent state management, model routing, and resource management. The work connects emerging research with reliable production platforms.Key Responsibilities: Build secure execution environments for agent-generated codeDesign identity, authentication,



and trust boundaries for agentsDevelop model routing across model types and environmentsManage quotas and resources for long-running agent workflowsCreate state, memory, and filesystem abstractionsRequirements: Production machine learning infrastructure experienceStrong systems fundamentals and distributed systems experienceHands-on agentic systems or multi-agent workflow experienceFamiliarity with model routing and LLM provider frameworksExperience with Kubernetes and fault-tolerant systemsApply systems depth and machine learning understanding to build secure, scalable agent infrastructure at Cohere for future AI systems.#J-18808-Ljbffr

📌 Senior Agent Infrastructure Engineer (Toronto)
🏢 Avenue.io
📍 Toronto