Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition in a remote-friendly workplace. Shape platforms for autonomous agents at scale.

As a Senior Staff Software Engineer, you will create infrastructure spanning machine learning systems, distributed infrastructure, and developer experience. You will support secure execution, agent state management, model routing, and resource management. The work connects emerging research with reliable production platforms.

Key Responsibilities:
Build secure execution environments for agent-generated code
Design identity, authentication, and trust boundaries for agents
Develop model routing across model types and settings




Manage quotas and resources for long-running agent workflows
Create state, memory, and filesystem abstractions

Requirements:
Production machine learning infrastructure experience
Solid systems fundamentals and distributed systems experience
Hands-on agentic systems or multi-agent workflow experience
Familiarity with model routing and LLM provider frameworks
Experience with Kubernetes and fault-tolerant systems

Apply systems depth and machine learning understanding to build secure, scalable agent infrastructure at Cohere for future AI systems.
J-18808-Ljbffr

📌 Senior Agent Infrastructure Engineer Toronto
🏢 Avenue.io
📍 Toronto