Support machine learning model serving at Baseten through scalable infrastructure, performance standards, and dependable operational processes. Learn directly from users building AI products.

As a Cloud Platform Engineer, you will build systems that keep model deployment and operation scalable, reliable, and productive. Your work may include multi-cloud capacity management, B200 GPU inference, multi-node inference, and fractional H100 GPU serving. You will also automate deployments, monitor systems, and manage incidents while owning projects end to end.

Key Responsibilities:

- Maintain infrastructure supporting machine learning model operations
- Optimize infrastructure performance and manage operational incidents




- Automate deployments and relevant engineering processes
- Own products and projects through specification and execution
- Mentor junior team members and share organizational knowledge

Requirements:

- Experience maintaining scalable infrastructure
- Extensive experience with Kubernetes
- Experience with infrastructure-as-code tools
- Experience with CI/CD tooling
- Openness to learning machine learning without prior experience

Apply infrastructure engineering judgment to help Baseten operate advanced model-serving systems across evolving AI workloads.

📌 Machine Learning Infrastructure Engineer (Montreal)
🏢 Baseten
📍 Montreal