Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups.

About The

RoleCerebras is building a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving system accessible, reliable, and easy to use. This role sits at the intersection of machine learning systems, API design, model serving, and distributed systems.

You will enable new model architectures and inference capabilities, define stable user-facing behavior, and ensure that features such as streaming, sampling, tool use, structured outputs, multimodal inputs, and model configuration behave correctly and consistently in production. You will work closely with model enablement, compiler, runtime, cloud infrastructure, product, customer-facing teams, and customers directly. This is a hands-on software engineering role for someone who enjoys turning rapidly evolving ML capabilities into durable, production-quality APIs.

Build production ML inference APIs. Design, implement, and maintain APIs for chat completions, text generation, streaming, model configuration, tool calling, structured outputs, multimodal inputs, and other emerging inference capabilities. Deliver a unified serving experience.

Integrate emerging foundation models, tokenizers, prompt formats, sampling methods, attention variants, multimodal inputs, and model-specific features into the serving platform. Integrate with model-serving runtimes. Build the control and data paths required to coordinate GPU prefill with Cerebras decode,



including request routing, state transfer, error handling, retries, and lifecycle management.

Improve serving performance. Optimize streaming behavior, time to first token, request latency, throughput, batching, serialization, tokenization, scheduling, and communication between serving components. Build validation systems for tokenization, sampling, logits, generated outputs, precision changes, model upgrades, determinism, and compatibility across serving backends.

Develop testing and qualification infrastructure. Create conformance tests, workload-replay tools, model-validation suites, performance benchmarks, integration tests, and release gates. Build intuitive configuration, SDKs, documentation, examples, debugging tools, and self-service workflows for internal developers, customers, and partners.

Partner with compiler, runtime, kernel, cloud, product, and solutions teams to translate model and customer requirements into scalable serving capabilities. 5+ years of software engineering experience, including substantial individual-contributor ownership of production software or distributed systems. Strong programming ability in Python and Go plus experience developing performance-sensitive or highly concurrent services in C++, Rust, or a similar systems language.

Experience building stable APIs with explicit validation, error handling, observability, compatibility, and versioning practices.

Experience integrating software across service, framework, runtime, and infrastructure boundaries.

Experience with Linux, containers, Kubernetes or comparable orchestration systems, CI/CD, and operating latency-sensitive services in production.



Ability to diagnose correctness, reliability, and performance issues across multiple components of a distributed serving system. Strong communication and cross-functional execution skills, with the ability to turn ambiguous model or product requirements into production-quality software.

Bachelor's degree in computer science, Computer Engineering, Electrical Engineering, or a related discipline, or equivalent practical experience.

Experience modifying or contributing to vLLM, SGLang, PyTorch, Hugging Face Transformers, Triton, TensorRT-LLM, or another open-source ML systems project.

Experience creating API conformance, model-quality, numerical-comparison, determinism, or performance-regression test systems Experience building SDKs, developer tools, model registries, configuration systems, or self-service ML platforms. Understanding of model-specific tokenization, chat templates, generation configuration, logits processing, stopping criteria, tool calling, structured generation, and constrained decoding.

Experience with disaggregated prefill/decode architectures, KV-cache transfer, prefix caching, chunked prefill, memory-aware admission control, or request scheduling.

Experience designing, building, or operating production APIs and services for machine learning, large language models, or other data-intensive applications.

Why Join

CerebrasAboutPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. Build a breakthrough AI platform beyond the constraints of the GPU.

Publish and open source their cutting-edge AI research. Work on one of the fastest AI supercomputers in the world. Our simple, non-corporate work culture that respects individual beliefs. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them. #

📌 Staff Software Development Engineer (Winnipeg)
🏢 Cerebras
📍 Winnipeg