Who you are

- Run a job platform, batch system, or Kubernetes controllers in production. Scheduling, queues, and multi-tenant fairness are central to this work

- Shown distributed systems judgment: retries, partial failure, and knowing what not to automate

- Worked on ML training workflows, RL sandboxes, container networking (CNI), or checkpoint storage at scale. Direct GPU-cluster experience is a plus

- Written software in Python or Go. You would rather extend a solid open-source project than rebuild it

- Worked with researchers, ML engineers, or another team whose goals were not identical to yours

- Found a bottleneck, proposed a fix, and driven it in a fast-moving setting

- If this does not line up exactly with your experience, we still encourage you to apply

What the job involves

- Internal Infrastructure builds the infrastructure and tools used to train, evaluate, and serve Cohere's foundation models. You will work with AI researchers and ML engineers on stability, scalability, and observability. The work accelerates the models behind Cohere's platform, North

- Build the platform that runs training, evaluation, and reinforcement-learning workloads, including job lifecycle, scheduling, workload networking, and storage for those jobs. The role includes a compensated 24x7 on-call rotation

- Own the platform that schedules and runs training, evaluation, and reinforcement-learning jobs on Kubernetes: determine capacity allocation, handle job failures,



and help researchers identify whether the platform caused a failure

- Build the networking and runtime isolation these workloads need, including agent and sandbox environments

- Work with the data infrastructure team on storage for checkpoints and other training artifacts

- Troubleshoot production failures and performance problems, and make the system easier to operate

- Build automation, infrastructure-as-code, and observability so the platform remains maintainable

- We hire at more than one level. We set level based on the scope you've owned and how independently you drive work

Benefits

- Six weeks’ paid vacation

- Equity / stock options
- RRSP, 401(k), and Pension Scheme contributions

- Coverage for 100% of your insurance premiums across health, dental, vision, and travel

- Additional coverage for accessing mental health providers/services

- Six months of fully paid parental leave, including adoption and surrogacy

- Financial support for egg freezing and IVF in Canada and the UK
- A monthly fitness and wellness allowance

- Globally dispersed company that supports a remote work culture
- A $2,000 annual education benefit for professional development
- A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
- A monthly arts and culture allowance
- A monthly quality time allowance

📌 Software Engineer (Canada)
🏢 Cohere
📍 Canada