Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production.
You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.Key Responsibilities:
- Build infrastructure for distributed LLM inference
- Design and operate advanced Model APIs
- Implement API versioning, validation, and quotas
- Instrument observability metrics and logs
- Debug complex systems across Kubernetes and GPURequirements:
- 3+ years in distributed systems or large-scale APIs
- Proven experience in reliable backend services
- Solid understanding of performance profiling and testing
- Comfort in debugging across application layers
- Excellent collaboration and documentation skillsBring your expertise to Baseten and contribute to shaping the future of AI products.
📌 Distributed Systems Engineer At Baseten (Montreal)
🏢 Baseten
📍 Montreal
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.