Senior Compiler Optimization Engineer — AI Accelerators

We’re working with an AI hardware company building a new compiler and software stack for high-performance accelerated computing.

This role sits in the middle of the compiler, transforming models and computational graphs into efficient programs for a new accelerator architecture. You’ll own optimizations that materially affect workload performance rather than maintaining an established toolchain.

What you’ll work on

- Design graph and IR-level compiler optimizations

- Develop transformation, fusion, scheduling and memory-planning passes

- Lower workloads through MLIR-based compilation pipelines

- Optimize data movement, parallelism and accelerator utilization

- Analyze generated programs and eliminate performance bottlenecks

- Collaborate with architecture,



code-generation and runtime engineers

- Help define how ML workloads should map onto the underlying hardware

What we’re looking for

- Strong C++ and compiler engineering experience

- Hands-on knowledge of LLVM, MLIR or comparable compiler infrastructure

- Experience with graph optimization, IR transformations or lowering

- Ability to reason across compiler decisions and hardware behavior

Experience with PyTorch compilation, Triton, GPUs, AI accelerators, memory optimization or hardware/software co-design would be particularly valuable.

This is an chance to shape a compiler while both the software stack and target architecture are still evolving.

📌 Compiler Engineer (Toronto)
🏢 Oho Group
📍 Toronto