Harness the power of AI at NVIDIA as a Senior Software Engineer focusing on AI inference systems. Architect solutions that enhance model performance in a flexible hybrid workplace.We're seeking a talented skilled to lead the optimization of GPU kernels and inference frameworks like vLLM at NVIDIA. This role involves critical contributions to benchmarking methodologies and containerized large-scale deployments, requiring deep knowledge in ML systems and performance optimization.Key Responsibilities:
Engineer features for vLLM to leverage NVIDIA hardware
Develop and benchmark GPU kernels with optimization techniques
Define efficient methodologies for inference benchmarking
Schedule and orchestrate large-scale inference on GPU clusters
Integrate research findings into NVIDIA software productsRequirements:
Bachelor’s degree with 7+ years or equivalent education
Proficient in Python and C/C++, with Go or Rust knowledge
Experience with GPU programming and ML frameworks
Skilled in Docker and Kubernetes for containerization
Robust debugging and communication capabilitiesStep into a role where your engineering skills will have a tangible impact on AI systems at NVIDIA.#J-18808-Ljbffr

📌 Senior Software Engineer, Ai Systems Optimization Toronto (Canada)
🏢 NVIDIA Gruppe
📍 Canada