Position Overview Autodesk is building industry foundation models for the future of design and make. This role helps define how we measure progress, understand our capability relative to the market, and connect that work to business priorities.

Job Requisition ID # 26WD101723

Position Overview Autodesk is building industry foundation models for the future of design and make. This role helps define how we measure progress, understand our capability relative to the market, and connect that work to business priorities.

You will set priorities for Autodesk's AI benchmarking program, which measures how our capabilities perform on the work that matters most in real world design and manufacturing, against frontier models, competitor technology, and industry baselines. You will interpret those results and turn them into guidance for research, product, and investment decisions. You will work with AI benchmarking engineers, researchers, and business leadership, with visibility up to C-suite.

Benchmarking is a key input to business decision making at Autodesk. Demand for this work is high and growing, internally and externally. Your job is to make sure the investment in benchmarking gives leaders a clear view of capability, competitive position, and where to focus next.

The person who succeeds here needs to be comfortable working across technical, customer, and business questions. You do not need to build or run the evaluations yourself. You do need enough technical fluency to challenge what is being measured, enough direct work with industry product managers to know where customer value is actually being delivered and whether a measured improvement is one customers recognize,



and the judgment to turn both into a clear point of view for leaders making investment decisions.

This is an individual contributor role with a path to people management.

Responsibilities Capability

Own and keep current how we prioritize what gets benchmarked, weighing workflow value, strategic importance, and competitive relevance

Map benchmark priorities to Industry Cloud problem areas and judge what level of evidence each question requires

Define the comparison set evaluated against those priorities, covering Autodesk and external alternatives

Collaborate on evolution of relevant human metrics and comparisons

Turn benchmark results into clear read-outs on Autodesk capability relative to frontier models, competitor technology, and industry baselines, including for the C-suite

Evolve the channels and cadence through which we report capability and competitive position

Keep capability questions moving to answers on a timeline that matches the decisions they support, including work that depends on teams you do not manage

Partner closely with the technical benchmarking team, which owns task curation and evaluation, to shape what gets measured next

Value

Own the translation from capability to business value

Evolve how we measure ROI for our models

Take a capability improvement and connect it to the workflow it changes, the customers it affects, and the revenue or cost implications





Own the customer and industry validation standard we use to evaluate current business bets

Work with industry product teams to ground what we measure in the workflows their customers run, and to confirm that a measured improvement is one customers recognize and value

Reconcile benchmark evidence with customer evidence when the two disagree, and determine which should carry the decision

Competitive

Turn comparative results into a clear view of how Autodesk capabilities are evolving relative to the market, and set the priorities competitive research works against

Translate meaningful differences in capability into research questions and investment recommendations with AI Research and AI Economics, informing scenario planning and build versus partner decisions

Minimum Qualifications

7+ years across strategy consulting, corporate or business strategy, technical product management, AI strategy, applied research, competitive intelligence, or related roles

Evaluation fluency - you can interrogate an evaluation result, challenge the metric, and determine whether a benchmark supports the conclusion being drawn from it

Business translation - you can take a change in capability and work through what it means for a workflow, a customer, a competitor, and ultimately a business decision

Structured problem solving - you are comfortable taking an ambiguous question, breaking it into the right components, working with incomplete evidence, and developing a defensible point of view

Movement between technical and business contexts - you can work credibly with researchers and engineers, then translate the relevant implicati

📌 AI Capability (Toronto)
🏢 Autodesk
📍 Toronto