Build secure machine learning infrastructure at Cohere, focusing on developer platforms, Kubernetes, Linux, and production reliability. This role is remote-friendly across Cohere’s global offices.

As a Software Engineer in ML Operations, you will support infrastructure for training, evaluating, and serving foundation models. You will work with AI researchers and machine learning engineers on stability, scalability, and observability. Your platform will support Cohere’s research organization and North.

Key Responsibilities:

- Run secure developer environments for research teams
- Own container image builds and CI/CD tooling
- Instrument training code and create self-service debugging tools
- Build automation, infrastructure-as-code, and observability




- Troubleshoot production failures and performance problems

Requirements:

- Production experience running developer platforms or internal tooling
- Linux and Kubernetes skills for production debugging
- Python or Go software development experience
- Experience supporting machine learning engineers or researchers
- GPU cluster operations experience is a plus

Help Cohere improve foundation-model infrastructure through secure platforms, reliable operations, automation, and machine learning enablement.

📌 Machine Learning Infrastructure Engineer (Toronto)
🏢 Cohere
📍 Toronto