Take on an exciting position at NVIDIA as a Software Engineer specializing in AI inference. This hybrid role focuses on architecting high-efficiency inference software using advanced GPU techniques.We are searching for motivated software engineers with strong programming skills and a background in ML frameworks. Your role will involve optimizing performance through creative features in vLLM and developing GPU kernels. Collaborating with diverse teams, you will push the limits of accelerated computing technology.Key Responsibilities:Develop features for vLLM with NVIDIA GPU hardwareOptimize framework using advanced engineering methodsConduct original research on ML Systems and techniquesImplement benchmarking and runtime optimizationsHandle profiling and debugging of GPU applicationsRequirements:Bachelor's, Master's, or PhD in Computer Science fieldMinimum 5 years of relevant experienceStrong grounding in algorithms and data structuresFamiliarity with CUDA and GPU programmingExcellent problem-solving and communication skillsLeverage your software engineering skills at NVIDIA and impact AI's future.#J-18808-Ljbffr

📌 Nvidia Software Engineer For Ai Inference (Toronto)
🏢 NVIDIA
📍 Toronto