19 Nov
|
Boson AI
|
Toronto
Optimize AI training and serving across Boson AI's 900-GPU cluster as a Toronto-based MScAC intern on a hybrid schedule.This eight-month applied research internship suits University of Toronto MScAC students interested in productive training and real-time inference. You may work with CUDA, Triton, SGLang, or vLLM while improving model speed, robustness, memory use, and serving capacity. The start date is May 2027, with earlier availability possible.Key Responsibilities:Optimize numerical formats, kernels, checkpointing, and recoveryOverlap communication with computation across multiple GPUsImprove quantization, decoding, and memory-layout performanceManage KV caches for concurrent usersScale streaming speech and video inference with demandRequirements:Enrollment in University of Toronto MScAC programStrong coding skills in PythonC++, CUDA, or Triton for systems projectsMachine learning foundations with PyTorch or JAX experienceAvailability for the full eight-month hybrid internshipApply systems optimization, GPU programming, and machine learning skills to Boson AI's large-scale training and inference infrastructure.
📌 Gpu Systems Research Intern (Toronto)
🏢 Boson AI
📍 Toronto