20 Nov
|
Cerebras
|
Toronto
Engineer distributed AI APIs at Cerebras Systems, combining production service ownership with routing, reliability, and performance diagnosis. As a Senior Software Engineer, you will build the software layer connecting GPU-accelerated prefill with Cerebras decode. The role combines distributed systems, API design, and model serving. You will lead features across components, coordinate partner teams, and support production operation. Key Responsibilities:
Write designs, evaluate tradeoffs, and coordinate milestones Implement retries, cancellation, error handling, and lifecycle management Maintain compatibility, versioning, validation, and deprecation practices Build conformance, integration, numerical, and performance tests Review code, mentor engineers,
and remove delivery roadblocks Requirements:
Five or more years of software engineering experience Experience delivering multi-component production features independently Production API experience covering compatibility, validation, and testing Linux services, containers, orchestration, and CI/CD experience Ability to turn ambiguous requirements into maintainable software Use distributed systems expertise to deliver dependable AI APIs, coordinate inference components, and improve production quality at Cerebras Systems.
📌 Senior Distributed Systems Engineer AI APIs (Toronto)
🏢 Cerebras
📍 Toronto