Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability. At Baseten, we're powering some of the most energetic AI companies and looking for engineers who excel in distributed systems.

In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities. Key Responsibilities:
Build infrastructure for distributed LLM inference
Design and operate advanced Model APIs
Implement API versioning, validation, and quotas
Instrument observability metrics and logs
Debug complex systems across Kubernetes and GPU Requirements:
3+ years in distributed systems or large-scale APIs
Proven experience in reliable backend services
Robust understanding of performance profiling and testing
Comfort in debugging across application layers
Excellent collaboration and documentation skills Bring your expertise to Baseten and contribute to shaping the future of AI products.

📌 Distributed Systems Engineer At Baseten Montreal
🏢 Baseten
📍 Montreal