Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.

This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work across request routing, fleet orchestration, load balancing, and deployment pipelines. The work spans diverse AI accelerators, cloud platforms, and emerging model architectures.

Key Responsibilities:

- Design distributed systems serving Claude to millions worldwide
- Develop real-time resilient systems for changing events
- Build routing, load balancing, and traffic management systems
- Autoscale and orchestrate production and research workloads
- Operate production-grade model deployment pipelines

Requirements:

- Significant software engineering experience with distributed systems
- Experience with high-performance large-scale distributed systems
- Experience deploying machine learning systems at scale
- Proficiency in Python or Rust
- Bachelor’s degree or equivalent education, training, or experience

Apply distributed systems, routing, and infrastructure expertise to advance Anthropic’s reliable, high-performance Claude inference platform.

📌 Senior Distributed Systems Software Engineer (Canada)
🏢 Fdetimes
📍 Canada