Baseten powers mission‑critical inference for the world’s most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. Join us and help build the platform engineers turn to to ship AI products.

We operate at the intersection of distributed systems, model performance, infrastructure, and developer experience. We enable customers to deploy and operate cutting‑edge LLM models with industry‑leading performance, scalability, reliability, and ease of use. As a Software Engineer on the Inference Stack team, you’ll work across the stack—from the developer experience customers use to deploy models, the libraries used for features like tool calling and reasoning, all the way down to the systems we use to orchestrate deployments in Kubernetes and route traffic efficiently.

Work across the stack, from customer‑facing features to low‑level infrastructure components Collaborate closely with Model Performance engineers to make new inference optimizations broadly available to customers and easy to configure Help define best practices around testing, release automation, benchmarking, and operational excellence Debug complex production systems spanning Kubernetes, distributed runtimes, networking, and GPU workloads Make thoughtful engineering tradeoffs balancing performance, reliability, operational simplicity, and developer experience Own projects end‑to‑end: from architecture and implementation through deployment, monitoring,



and iteration based on customer feedback Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or a related field Strong background in distributed systems, backend infrastructure, or platform engineering Experience building and operating production systems where reliability, latency, and scale are first‑class concerns Motivated and willing to learn new languages, frameworks, and systems as needed Bonus Experience contributing to open‑source infrastructure or ML systems Competitive compensation, including meaningful equity. ~100% coverage of medical, dental, and vision insurance for employee and dependents ~ Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to Recent Year’s Day!) ~ Paid parental leave ~ Fertility and family‑building stipend through Carrot ~ Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities. Embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a team-oriented and forward‑thinking team, we would love to hear from you.

We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

📌 Full-stack AI Software Engineer (M/F) (Montreal)
🏢 Baseten
📍 Montreal