Job ID26WD101723Job Requisition ID #26WD101723Position OverviewAutodesk is building industry foundation models for the future of design and make. This role helps define how we measure progress, understand our capability relative to the market, and connect that work to business priorities.
You will set priorities for Autodesk's AI benchmarking program, which measures how our capabilities perform on the work that matters most in real world design and manufacturing, against frontier models, competitor technology, and industry baselines. You will interpret those results and turn them into guidance for research, product, and investment decisions. You will work with AI benchmarking engineers, researchers, and business leadership, with visibility up to C-suite.
Benchmarking is a key input to business decision making at Autodesk. Demand for this work is high and growing, internally and externally. Your job is to make sure the investment in benchmarking gives leaders a clear view of capability, competitive position, and where to focus next.
The person who succeeds here needs to be comfortable working across technical, customer, and business questions. You do not need to build or run the evaluations yourself. You do need enough technical fluency to challenge what is being measured, enough direct work with industry product managers to know where customer value is actually being delivered and whether a measured improvement is one customers recognize, and the judgment to turn both into a clear point of view for leaders making investment decisions.
This is an individual contributor role with a path to people management.
ResponsibilitiesCapabilityOwn and keep current how we prioritize what gets benchmarked, weighing workflow value, strategic importance,



and competitive relevanceMap benchmark priorities to Industry Cloud problem areas and judge what level of evidence each question requiresDefine the comparison set evaluated against those priorities, covering Autodesk and external alternativesCollaborate on evolution of relevant human metrics and comparisonsTurn benchmark results into clear read-outs on Autodesk capability relative to frontier models, competitor technology, and industry baselines, including for the C-suiteEvolve the channels and cadence through which we report capability and competitive positionKeep capability questions moving to answers on a timeline that matches the decisions they support, including work that depends on teams you do not managePartner closely with the technical benchmarking team, which owns task curation and evaluation, to shape what gets measured nextValueOwn the translation from capability to business valueEvolve how we measure ROI for our modelsTake a capability improvement and connect it to the workflow it changes, the customers it affects, and the revenue or cost implicationsOwn the customer and industry validation standard we use to evaluate new business betsWork with industry product teams to ground what we measure in the workflows their customers run, and to confirm that a measured improvement is one customers recognize and valueReconcile benchmark evidence with customer evidence when the two disagree,



and determine which should carry the decisionCompetitiveTurn comparative results into a explicit view of how Autodesk capabilities are evolving relative to the market, and set the priorities competitive research works againstTranslate meaningful differences in capability into research questions and investment recommendations with AI Research and AI Economics, informing scenario planning and build versus partner decisionsMinimum Qualifications7+ years across strategy consulting, corporate or business strategy, technical product management, AI strategy, applied research, competitive intelligence, or related rolesEvaluation fluency
- you can interrogate an evaluation result, challenge the metric, and determine whether a benchmark supports the conclusion being drawn from itBusiness translation
- you can take a change in capability and work through what it means for a workflow, a customer, a competitor, and ultimately a business decisionStructured problem solving
- you are comfortable taking an ambiguous question, breaking it into the right components, working with incomplete evidence, and developing a defensible point of viewMovement between technical and business contexts
- you can work credibly with researchers and engineers, then translate the relevant implications for executives without losing the substanceMomentum
- you bring a working rhythm that others can plan around, and you help shorten the distance between a question being raised and an answer being availableTrack record of influencing research, product, or investment priorities without direct authorityStrong analytical judgment and clear, concise executive communicationBachelor's degree or equivalent practical experiencePreferred QualificationsExperience in strategy consulting, product strategy, or another role requiring structured a

📌 AI Capability (Toronto)
🏢 Autodesk
📍 Toronto