17 Nov
|
Blue J
|
Toronto
Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.
As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.
Key Responsibilities:
- Surface unknowns, clarify requirements, and identify overlooked use cases
- Devise test scenarios aligned with real-world user problems
- Lead exploratory and regression testing for feature releases
- Investigate bugs, feedback, root causes, and potential solutions
- Expand LLM evaluation tools using production system metrics
Requirements:
- Five-plus years in a quality-focused role
- Ability to read and debug production code
- Experience writing maintainable tools for QA automation
- Ability to query millions of SQL rows for anomalies
- Solid communication and user-first product thinking
Bring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.
#J-18808-Ljbffr
📌 Quality Engineering Strategist Llm Systems (Toronto)
🏢 Blue J
📍 Toronto