06 Nov
|
Huawei Canada
|
Winnipeg
06 Nov
Huawei Canada
Winnipeg
Advance Ascend NPU performance at Huawei Canada through kernel development and distributed training optimization for foundation models. As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters. Key Responsibilities:
Design and tune FlashAttention and GEMM operators using AscendC Optimize MindSpeed pre-training and reinforcement learning post-training pipelines Tune hybrid parallelism and rollout actor pipelining Implement FP8, MXFP8, and mixed-precision training schemes Profile Ascend hardware using msprof and PyTorch Profiler Requirements:
Bachelor’s, Master’s, or PhD in a related technical discipline Three or more years in HPC or distributed model systems Experience with AscendC, CANN, or CUDA C/C++ Proficiency in up-to-date Python and PyTorch custom extensions Experience with AI hardware profiling and debugging tools Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
📌 Senior Ascend NPU Systems Engineer (Winnipeg)
🏢 Huawei Canada
📍 Winnipeg