Quality Engineering Strategist LLM Systems (Winnipeg)

Quality Engineering Strategist LLM Systems (Winnipeg)

18 Nov
|
Blue J
|
Winnipeg

18 Nov

Blue J

Winnipeg

Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.

As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.

Key Responsibilities

Surface unknowns, clarify requirements, and identify overlooked use cases

Devise test scenarios aligned with real-world user problems

Lead exploratory and regression testing for feature releases





Investigate bugs, feedback, root causes, and potential solutions

Expand LLM evaluation tools using production system metrics

Requirements

Five-plus years in a quality-focused role

Ability to read and debug production code

Experience writing maintainable tools for QA automation

Ability to query millions of SQL rows for anomalies

Solid communication and user-first product thinking

Bring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.

📌 Quality Engineering Strategist LLM Systems (Winnipeg)
🏢 Blue J
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: quality engineering strategist llm systems (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: quality engineering strategist llm systems (winnipeg) / winnipeg