Technical Product Manager, Applied Science - AI Products (Toronto)

Technical Product Manager, Applied Science - AI Products (Toronto)

15 Sep
|
Socket.dev
|
Toronto

15 Sep

Socket.dev

Toronto

Caseware is one of Canada's original Fintech companies, having led the global audit and accounting software industry for over 30 years, with more than 500,000 users across 130 countries and available in 16 different languages. While you might not have heard of us (yet) over 36,000 accounting and audit professionals list Caseware as a skill on their LinkedIn profiles. We're looking for a Technical Product Manager to own how Caseware builds, evaluates, and raises the quality of AI across the platform.

You are the product owner of our core AI surfaces: the agents and agent builder practitioners use to do real work, the eval builder and eval roadmap that let us measure quality, and the agentic memory that lets the platform improve as it is used. You own the product outcome and the quality bar; the applied science team owns the science underneath it. Independent audit is one of the quiet foundations of the global economy — when investors, lenders, and regulators can trust that financial statements are accurate, capital flows and markets function.

That trust rests entirely on the quality of the work, which is why the bar for AI here is so high. What you do need is genuine curiosity about the complexity of auditing and a deep appreciation for why quality is non‑negotiable. This a full-time, permanent position You willbe requiredto work from our Toronto office 3-days a week,locatedat 351 King Street East, Toronto, ON Own agents, the agent builder, the eval builder, and agentic memory as products: their roadmap, sequencing, and the business outcomes they drive, using results and practitioner feedback to shape what ships.

Own the applied-science delivery roadmap and cross-team orchestration for the Caseware AI platform — sequence the evaluation, agentic-memory, and platform workstreams into a single plan, and keep delivery moving. Own the product acceptance bar for every AI feature — decide when an output is positive enough to put in front of practitioners, and set the eval baseline so every agent and skill is measured against a stated bar. Embed with domain experts and partner accounting and audit firms to validate AI outputs against professional standards — not just user preferences,



but what a qualified practitioner would actually sign off on.

Be the voice of the practitioner as an SME proxy — shadow real audit workflows, test prototypes in context, and translate “this doesn't feel right” into specific, actionable failure modes the team can act on. Work daily with engineering to turn precise problem statements into well-scoped requirements, with acceptance criteria agreed before development begins. Stay ahead of the AI landscape — monitor model developments, new architectures, emerging agent patterns, and competitor moves, and bring a clear product point of view on what matters for Caseware.

Define and own product health metrics for AI features: task completion, correction rates, override frequency, trust signals, and time-to-completion — and use them to drive product decisions. 6+ years of experience in technology-focused product management or product development, including 3–4 years working deeply with AI or machine learning–driven products. Software engineers transitioning into PM are welcome. ~ Proven ability to drive delivery across multiple technical teams coordinating dependencies, shared interfaces, and timelines across applied-science, and platform‑engineering pod. ~ Direct experience building and running eval frameworks for production AI products: defining acceptance bars, running human‑in‑the‑loop, practitioner validation, regression tracking across releases, and using results to decide what ships. ~ Technical fluency in LLMs, RAG, prompt engineering, embeddings, and agentic patterns, enough to drive substantive conversations with engineers and know when a product problem is a model problem. ~ Intellectual curiosity about AI — you follow model releases, read research, understand what frontier labs are shipping,



and form your own views on what matters. ~ Experience being the voice of the customer or practitioner: working with domain experts or subject matter specialists to define quality bars in high‑stakes, regulated, or professional‑grade contexts. ~ The annual base salary for this position is between $125,000 CAD and $135,000 CAD per year. This role is also eligible for discretionary bonus and/or commission, as well as other benefits.

We work with cutting‑edge technology in accounting and financial reporting, constantly pushing the boundaries to create impactful software solutions.

We offer flexible work options, remote opportunities, and generous time‑off policies to ensure a healthy work-life balance.

We offer competitive compensation, including a competitive salary and comprehensive benefits such as health insurance and retirement plans. Your contributions directly affect how our clients manage financial processes and drive their success. We celebrate hard work through recognition programs, performance bonuses, and opportunities for career growth.

Work on international projects and collaborate with a diverse, global team. Caseware's cutting-edge software products are meticulously designed for accounting firms, corporations, and governments. Our teams are continually collaborating, innovating, and building upon our existing suite of products.

With a customer-focused mindset, we are building technology that is shaping what the future of audits, financial reporting, and financial data analytics will look like. One of Caseware's core values is Many Voices, One Team and with that in mind, we're dedicated to building teams as diverse as our customers in an equitable and inclusive way.

AI Usage: The recruitment process may use AI assisted tools but not for candidate screening or assessment. co which typically includes an Identity Verification and Criminal Record Check. Executives and Senior Managers will undergo a Soft Credit Check as well.

Security and Fraud: com and our open positions are always listed on reputable job boards and on our website We will NEVER ask for payment or financial information from you.

📌 Technical Product Manager, Applied Science - AI Products (Toronto)
🏢 Socket.dev
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: technical product manager, applied science - ai products (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: technical product manager, applied science - ai products (toronto) / toronto