Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.

This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work across request routing, fleet orchestration, load balancing, and deployment pipelines. The work spans diverse AI accelerators, cloud platforms, and emerging model architectures.

Key Responsibilities

Design distributed systems serving Claude to millions worldwide

Develop real-time resilient systems for changing events

Build routing, load balancing, and traffic management systems

Autoscale and orchestrate production and research workloads

Operate production-grade model deployment pipelines

Requirements

Significant software engineering experience with distributed systems

Experience with high-performance large-scale distributed systems

Experience deploying machine learning systems at scale

Proficiency in Python or Rust

Bachelor’s degree or equivalent education, training, or experience

Apply distributed systems, routing, and infrastructure expertise to advance Anthropic’s reliable, high-performance Claude inference platform.

📌 Senior Distributed Systems Software Engineer (Winnipeg)
🏢 Fdetimes
📍 Winnipeg