Harness the power of AI at NVIDIA as a Senior Software Engineer focusing on AI inference systems. Architect solutions that enhance model performance in a flexible hybrid environment.

We're seeking a talented professional to lead the optimization of GPU kernels and inference frameworks like vLLM at NVIDIA. This role involves critical contributions to benchmarking methodologies and containerized large-scale deployments, requiring deep knowledge in ML systems and performance optimization.

Key Responsibilities:
• Engineer features for vLLM to leverage NVIDIA hardware
• Develop and benchmark GPU kernels with optimization techniques
• Define efficient methodologies for inference benchmarking




• Schedule and orchestrate large-scale inference on GPU clusters
• Integrate research findings into NVIDIA software products

Requirements:
• Bachelor’s degree with 7+ years or equivalent education
• Proficient in Python and C/C++, with Go or Rust knowledge
• Experience with GPU programming and ML frameworks
• Skilled in Docker and Kubernetes for containerization
• Robust debugging and communication capabilities

Step into a role where your engineering skills will have a tangible impact on AI systems at NVIDIA.
#J-18808-Ljbffr

📌 Senior Software Engineer, AI Systems Optimization (Ontario)
🏢 NVIDIA Gruppe
📍 Ontario