Overview

The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is enabled by a cutting‑edge software stack—the AWS Neuron Software Development Kit (SDK)—which includes an ML compiler, runtime and natively integrates into popular ML frameworks, such as PyTorch, TensorFlow and MxNet. The Neuron SDK optimizes performance of complex neural‑net models executed on AWS Inferentia and Trainium. AWS Neuron is used at scale with customers and partners like PyTorch, Epic Games, Snap, AirBnB, Autodesk, Amazon Alexa, Amazon Rekognition and other customers in various segments.

Responsibilities

- Lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium.
- Leverage vision and technical communication skills as a hands‑on partner to AWS ML services teams, contributing to pre‑silicon design, current product releases, optimizations, and features that meet customer needs.
- Apply deep knowledge of resource management, scheduling, code generation, optimization and novel instruction architectures (CPU, NPU, GPU and emerging compute).
- Drive software architecture efficiencies, implement automation, resolve root causes of defects, and build high‑impact solutions for a large customer base.
- Participate in design discussions, code review, cross‑functional business decisions, and startup‑like development environment.

A Day in the Life





- Design and code solutions that drive software architecture efficiencies.
- Create metrics, implement automation, and improve bugs/defects.
- Deliver high‑impact solutions to a large customer base.
- Participate in design discussions, code review, and communicate with stakeholders.
- Work cross‑functionally to influence business decisions with technical input.
- Operate in a startup‑like environment, tackling the most important projects.

Basic Qualifications

- 6+ years of engineering team management experience.
- 8+ years of direct engineering work experience.
- 6+ years of designing or architecting new and existing systems (design patterns, reliability and scaling).
- Experience partnering with product or program management teams.
- Demonstrated software engineering skills through relevant experience (internships, work, competitions, publications) and strong analytical, attention‑to‑detail and effective communication skills.

Preferred Qualifications

- M.S. or Ph.D. in Computer Science or related technical field.
- Experience with toolchains (LLVM, GCC) and code‑generation techniques for new hardware.
- Knowledge of compiler internals from front end to runtime with emphasis on AI acceleration.

Location

Toronto, Canada – candidates must be currently located or willing to relocate.

Compensation

Base salary range: 214,200.00 – 357,800.00 CAD annually.

Equal Opportunity Statement

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, visit for more information.

#J-18808-Ljbffr

📌 Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs (Toronto)
🏢 Amazon Web Services (AWS)
📍 Toronto