06 Nov
|
Huawei Canada
|
Vancouver
06 Nov
Huawei Canada
Vancouver
Advance Ascend NPU performance at Huawei Canada through kernel development and distributed training optimization for foundation models. As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters.
Key Responsibilities
- Design and tune FlashAttention and GEMM operators using AscendC
- Optimize MindSpeed pre-training and reinforcement learning post-training pipelines
- Tune hybrid parallelism and rollout actor pipelining
- Implement FP8, MXFP8, and mixed-precision training schemes
- Profile Ascend hardware using msprof and PyTorch Profiler
Requirements:
- Bachelor’s, Master’s, or PhD in a related technical discipline
- Three or more years in HPC or distributed model systems
- Experience with AscendC, CANN, or CUDA C/C++
- Proficiency in contemporary Python and PyTorch custom extensions
- Experience with AI hardware profiling and debugging tools Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
📌 Senior Ascend NPU Systems Engineer (Vancouver)
🏢 Huawei Canada
📍 Vancouver