Senior AI Engineer, AI Inference SystemsLocation: Pacific Time (US & Canada) (UTC-08:00). Employment: Full-time. Salary: 250k - 350k USD/year.OverviewFounded by a team of Cambridge ex quant‑traders and researchers, with over 5 trillion tokens served per month to 5 million users, Chai has quickly established itself as one of the fastest‑growing AI startups in Palo Alto.Team CultureOur leadership promotes a high‑velocity, hard‑working setting with a focus on reliability and high standards. We value autonomy and expect each member to contribute to the team’s success through proactive engagement and innovation.DescriptionWe need a relentless engineer with 3+ years of experience overseeing and being responsible for optimizing our LLM inference engine, ensuring it is performant, scalable, and cost‑efficient.



You will work alongside equally talented and driven teammates implementing cutting‑edge AI inference engines. We need someone who is reliable and has high standards.Benefits of JoiningExponential growth: 1 Million MAU now, aiming for 100 Million MAU.Craftsmanship: Build something beautiful.RequirementsFamiliar with vLLM, quantization, and current techniques of LLM optimization.3+ years of experience in software engineering.Bachelor or Master degree from a leading academic institution.Tech StackFront end: Python, Flutter, Dart.Back end: Python, GCP, Redis, Kubernetes.#J-18808-Ljbffr

📌 Senior Ai Engineer, Ai Inference Systems - $250,000 A Year (Toronto)
🏢 Chai
📍 Toronto