Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition. This remote-friendly role supports offices worldwide.
As a Senior Staff Software Engineer, you will create the platform powering autonomous AI agents at scale. Your work spans secure execution, model routing, identity, authentication, and resource management. You will connect ML research with reliable production infrastructure.
Key Responsibilities: Build secure execution environments for agent-generated code
Develop identity, authentication, and trust boundaries for agents
Orchestrate model routing across model types and environments
Manage rate limits, quotas, and agent workflow resources
Create state, memory, and filesystem abstractions
Requirements: Production ML infrastructure experience with robust systems fundamentals
Hands-on experience with agentic or multi-agent systems
Familiarity with model routing and LLM provider frameworks
Experience with scalable distributed systems and Kubernetes
Proven ability to prototype and productionize effectively
Apply systems depth and ML intuition to build secure, scalable agent infrastructure at Cohere across evolving AI environments.

#J-18808-Ljbffr

📌 Senior Staff AI Infrastructure Engineer (Ontario)
🏢 Fdetimes
📍 Ontario