Quality Engineering Strategist LLM Systems (Ontario)

Quality Engineering Strategist LLM Systems (Ontario)

16 Nov
|
Blue J
|
Ontario

16 Nov

Blue J

Ontario

Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.
As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.
Key Responsibilities: Surface unknowns, clarify requirements, and identify overlooked use cases
Devise test scenarios aligned with real-world user problems
Lead exploratory and regression testing for feature releases




Investigate bugs, feedback, root causes, and potential solutions
Expand LLM evaluation tools using production system metrics
Requirements: Five-plus years in a quality-focused role
Ability to read and debug production code
Experience writing maintainable tools for QA automation
Ability to query millions of SQL rows for anomalies
Solid communication and user-first product thinking
Bring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.

#J-18808-Ljbffr

📌 Quality Engineering Strategist LLM Systems (Ontario)
🏢 Blue J
📍 Ontario

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: quality engineering strategist llm systems (ontario) / ontario