Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition. This remote-friendly role supports offices worldwide.

As a Senior Staff Software Engineer, you will create the platform powering autonomous AI agents at scale. Your work spans secure execution, model routing, identity, authentication, and resource management. You will connect ML research with reliable production infrastructure.

Key Responsibilities: Build secure execution environments for agent-generated code

Develop identity, authentication, and trust boundaries for agents

Orchestrate model routing across model types and environments

Manage rate limits, quotas, and agent workflow resources

Create state, memory, and filesystem abstractions

Requirements: Production ML infrastructure experience with solid systems fundamentals

Hands-on experience with agentic or multi-agent systems

Familiarity with model routing and LLM provider frameworks

Experience with scalable distributed systems and Kubernetes

Proven ability to prototype and productionize effectively

Apply systems depth and ML intuition to build secure, scalable agent infrastructure at Cohere across evolving AI environments.

📌 Senior Staff Ai Infrastructure Engineer (Toronto)
🏢 Fdetimes
📍 Toronto