Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability. At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems.

In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities. Key Responsibilities:

- Build infrastructure for distributed LLM inference
- Design and operate advanced Model APIs
- Implement API versioning, validation, and quotas
- Instrument observability metrics and logs
- Debug complex systems across Kubernetes and GPU Requirements:
- 3+ years in distributed systems or large-scale APIs
- Proven experience in reliable backend services
- Robust understanding of performance profiling and testing
- Comfort in debugging across application layers
- Excellent collaboration and documentation skills Bring your expertise to Baseten and contribute to shaping the future of AI products.

📌 Distributed Systems Engineer at Baseten (Montreal)
🏢 Baseten
📍 Montreal