Advance Ascend NPU performance at Huawei Canada through kernel development and distributed training optimization for foundation models.
As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters.
Key Responsibilities: Design and tune FlashAttention and GEMM operators using AscendC
Optimize MindSpeed pre-training and reinforcement learning post-training pipelines
Tune hybrid parallelism and rollout actor pipelining
Implement FP8, MXFP8, and mixed-precision training schemes
Profile Ascend hardware using msprof and PyTorch Profiler
Requirements: Bachelor’s, Master’s, or PhD in a related technical discipline
Three or more years in HPC or distributed model systems
Experience with AscendC, CANN, or CUDA C/C++
Proficiency in up-to-date Python and PyTorch custom extensions
Experience with AI hardware profiling and debugging tools
Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
#J-18808-Ljbffr
📌 Senior Ascend NPU Systems Engineer (British Columbia)
🏢 Huawei Canada
📍 British Columbia
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.