Senior Compiler Optimization Engineer — AI Accelerators

We’re working with an AI hardware company building a current compiler and software stack for high-performance accelerated computing.

This role sits in the middle of the compiler, transforming models and computational graphs into productive programs for a recent accelerator architecture. You’ll own optimizations that materially affect workload performance rather than maintaining an established toolchain.

What you’ll work on
Design graph and IR-level compiler optimizations
Develop transformation, fusion, scheduling and memory-planning passes
Lower workloads through MLIR-based compilation pipelines
Optimize data movement, parallelism and accelerator utilization
Analyze generated programs and eliminate performance bottlenecks
Collaborate with architecture, code-generation and runtime engineers




Help define how ML workloads should map onto the underlying hardware

What we’re looking for
Solid C++ and compiler engineering experience
Hands-on knowledge of LLVM, MLIR or comparable compiler infrastructure
Experience with graph optimization, IR transformations or lowering
Ability to reason across compiler decisions and hardware behavior

Experience with PyTorch compilation, Triton, GPUs, AI accelerators, memory optimization or hardware/software co-design would be particularly valuable.

This is an opportunity to shape a compiler while both the software stack and target architecture are still evolving.
J-18808-Ljbffr

📌 Compiler Engineer Toronto
🏢 Oho Group
📍 Toronto