Build machine learning APIs at Cerebras Systems using Python and distributed systems expertise to power heterogeneous AI inference services.
As a Senior Software Engineer, you will evolve the ML API layer across inference APIs, model integration, and request routing. The work spans API design, model serving, and distributed systems. You will translate model capabilities and customer requirements into reliable production software.
Key Responsibilities
Own inference features from design through production operationImplement chat, streaming, sampling, tool calling, and structured outputsIntegrate models, tokenizers, templates, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
Five or more years of software engineering experienceStrong Python programming and proficiency in another production languageExperience evolving production APIs and distributed componentsExperience with Linux, containers, Kubernetes, and CI/CDAbility to diagnose correctness, reliability, and performance issuesApply machine learning systems, API design, and distributed software expertise to advance Cerebras inference reliability and performance.