Advance Ascend NPU performance at Huawei Canada through kernel development and distributed training optimization for foundation models. As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters. Key Responsibilities:
Design and tune FlashAttention and GEMM operators using AscendC Optimize MindSpeed pre-training and reinforcement learning post-training pipelines Tune hybrid parallelism and rollout actor pipelining Implement FP8, MXFP8, and mixed-precision training schemes Profile Ascend hardware using msprof and PyTorch Profiler Requirements:
Bachelor’s, Master’s, or PhD in a related technical discipline Three or more years in HPC or distributed model systems Experience with AscendC, CANN, or CUDA C/C++ Proficiency in contemporary Python and PyTorch custom extensions Experience with AI hardware profiling and debugging tools Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
📌 Senior Ascend NPU Systems Engineer (Vancouver)
🏢 Huawei Canada
📍 Vancouver
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.