Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition. This remote-friendly role supports offices worldwide.

As a Senior Staff Software Engineer, you will create the platform powering autonomous AI agents at scale. Your work spans secure execution, model routing, identity, authentication, and resource management. You will connect ML research with reliable production infrastructure.

Key Responsibilities:

- Build secure execution environments for agent-generated code
- Develop identity, authentication, and trust boundaries for agents
- Orchestrate model routing across model types and environments
- Manage rate limits, quotas, and agent workflow resources
- Create state, memory,



and filesystem abstractions

Requirements:

- Production ML infrastructure experience with robust systems fundamentals
- Hands-on experience with agentic or multi-agent systems
- Familiarity with model routing and LLM provider frameworks
- Experience with scalable distributed systems and Kubernetes
- Proven ability to prototype and productionize effectively

Apply systems depth and ML intuition to build secure, scalable agent infrastructure at Cohere across evolving AI environments.

#J-18808-Ljbffr

📌 Senior Staff AI Infrastructure Engineer (Toronto)
🏢 Fdetimes
📍 Toronto