DESCRIPTION Amazon Web Services (AWS) is building machine learning accelerators—Inferentia and Trainium—embedded within the AWS Neuron software stack. The role supports the design, deployment, and scaling of the compiler that powers inference and training on these custom chips. The manager leads a team of compiler engineers and works closely with AWS ML services to deliver high‑performance, low‑cost solutions for customers.

RESPONSIBILITIES Lead and mentor a team of compiler engineers, setting goals and ensuring timely delivery of new features.

Own the engineering process for the Neuron compiler, from design and code generation to optimization and runtime integration.

Work cross‑functionally with product, program management, and hardware verification teams to define scope, trade‑offs, and release plans.

Drive continuous improvement and automation of build, test, and deployment pipelines to reduce cycle time and increase quality.

Mentor junior staff, conduct code reviews, and foster knowledge sharing across the team.

Communicate design decisions, risks, and status to leadership and stakeholders.

LOCATION Toronto,



Ontario, Canada. Candidates must be located or willing to relocate.

BASIC QUALIFICATIONS 6+ years of engineering team management experience.

8+ years of direct engineering experience.

6+ years designing or architecting scalable systems.

Experience partnering with product or program management.

Robust software engineering skills and analytical aptitude.

PREFERRED QUALIFICATIONS M.S. or Ph.D. in Computer Science or related technical field.

Experience with toolchains (LLVM, GCC) and code generation for hardware.

In‑depth knowledge of compiler internals, especially for AI acceleration.

EEO STATEMENT Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or any other legally protected status.

COMPENSATION &

BENEFITS Base salary: 214,200 – 357,800 CAD annually. Total compensation may include signing bonus, RSUs, and other benefits such as health insurance, RRSP, DPSP, and paid time off.

📌 Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs (Toronto)
🏢 Amazon Development Centre Canada ULC
📍 Toronto