Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition in a remote-friendly environment. Shape platforms for autonomous agents at scale.
As a Senior Staff Software Engineer, you will create infrastructure spanning machine learning systems, distributed infrastructure, and developer experience. You will support secure execution, agent state management, model routing, and resource management. The work connects emerging research with reliable production platforms.
Key Responsibilities: Build secure execution environments for agent-generated code
Design identity, authentication, and trust boundaries for agents
Develop model routing across model types and environments




Manage quotas and resources for long-running agent workflows
Create state, memory, and filesystem abstractions
Requirements: Production machine learning infrastructure experience
Robust systems fundamentals and distributed systems experience
Hands-on agentic systems or multi-agent workflow experience
Familiarity with model routing and LLM provider frameworks
Experience with Kubernetes and fault-tolerant systems
Apply systems depth and machine learning understanding to build secure, scalable agent infrastructure at Cohere for future AI systems.

#J-18808-Ljbffr

📌 Senior Agent Infrastructure Engineer (Ontario)
🏢 Avenue.io
📍 Ontario