Join our creative team as an AI Performance Software Engineer, building advanced inference systems for large-scale models with cutting-edge GPU optimization. Collaborate with experts and drive efficiency in accelerated computing.We are seeking top-tier software engineers to architect and implement high-performance AI inference software. In this role, you'll focus on optimizing GPU kernels and driving benchmarks while collaborating with various teams.



Your contributions will significantly enhance the efficiency of machine learning frameworks and inference engines like vLLM and SGLang.Key Responsibilities:Develop features for vLLM utilizing the latest GPU hardwareProfile and optimize inference frameworks and algorithmsArchitect novel frameworks and runtime optimizationsConduct and publish original research in ML SystemsDevelop and benchmark GPU kernels using performance techniquesRequirements:Bachelor's, Master's, or PhD in Computer Science or related field5+ years industry experience in software engineering or researchStrong programming in Python and C/C++, Go, or RustPassion for performance engineering in ML frameworksExcellent debugging and communication skillsElevate AI systems and contribute to groundbreaking research with us today.#J-18808-Ljbffr

📌 Ai Performance Software Engineer Role (Toronto)
🏢 United States Digital Space
📍 Toronto