Verily Health combines technology, data science, and healthcare to transform complex health data into trusted intelligence. Its flagship platform, Verily Pre, enables healthcare organizations to responsibly govern, model, and securely activate protected health data at scale, with the scientific rigor, oversight, and auditability that healthcare requires. Verily builds solutions for customers across life sciences, health systems, health plans, and patients, all powered by AI capabilities. The role This role owns the product strategy for Verily's AI Evaluation Harness: the capabilities that first
- and third-party AI developers use to benchmark, evaluate, monitor, and improve AI in healthcare. The harness spans golden-dataset evaluations, code assertions, LLM-as-a-judge evaluations, error analysis, and customer feedback signals, covering everything from quick one-off checks to long-running validation for regulated use. You would set a 12-month strategy and a longer vision for what evaluation becomes in healthcare, then lead a team of software engineers and AI developers, working alongside them every day to build it. What you would do
- Build evaluation tools for AI developers across many customers, verticals, and clinical risk levels, treating this as a platform rather than a point solution.
- Map end-user journeys, identify unmet needs, and run continuous discovery, delivery, and iteration with your team, taking direct responsibility for end-to-end user value.
- Work as a peer with software architects, engineers, and data scientists on architecture and AI tradeoffs, aligning solutions with Verily's existing platform capabilities.
- Collaborate with clinical, regulatory, quality, security, and data science experts to right-size and de-risk solutions for healthcare compliance constraints.
- Develop and communicate product strategy at multiple levels of detail: 12-month strategy, half-year milestones, quarterly delivery roadmap, and biweekly sprint priorities.




- Drive the roadmap across error analysis, golden datasets, code assertions, LLM-as-a-judge, and customer feedback signals, and align stakeholders when interests conflict. What they are looking for
- 5+ years of product management on platform products, with a record of shipping and operating products while embedded with engineering scrum teams.
- Hands-on experience shipping AI evaluation tooling that customers use (LLM-as-a-judge frameworks, golden datasets, code assertions, trace tooling), with demonstrable adoption and quality outcomes.
- A deep technical background in software engineering, systems engineering, data science, clinical informatics, or a comparable discipline, sufficient to review architecture and discuss LLM behavior credibly with engineers and data scientists.
- Demonstrated ability to align technical and non-technical leaders around a single product vision and move conflicted groups to a decision.
- Experience owning a multi-tenant, version-controlled platform in a high-growth environment, including real tenancy, versioning, and backward-compatibility tradeoffs.
- (Preferred) Healthcare domain fluency: FHIR resources, clinical informatics, and interoperability standards.
- (Preferred) Experience navigating regulated environments such as HIPAA, GxP, or FDA SaMD, including building validation or audit evidence into a product.
- (Preferred) Experience building evaluations for clinical or high-stakes AI outputs (summarization, coding, triage, decision support), including clinician-in-the-loop labeling and adjudication. Working arrangements This is a hybrid role based in Waterloo, Ontario, Canada. Candidates must be legally authorized to work in Canada. Verily is currently unable to offer employment-based visa or work permit sponsorship for this position. Pay and perks The base salary range for this position is CAD 132,500
- CAD 149,000, plus bonus, equity, and benefits. Individual pay within the range is determined by work location, skills, experience, and relevant education or training.

📌 Senior Product Manager, AI Platform (Ottawa)
🏢 Hard Problems
📍 Ottawa