Quality Engineering Strategist Llm Systems (Toronto)

Quality Engineering Strategist Llm Systems (Toronto)

17 Nov
|
Blue J
|
Toronto

17 Nov

Blue J

Toronto

Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.

As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.

Key Responsibilities:

- Surface unknowns, clarify requirements, and identify overlooked use cases
- Devise test scenarios aligned with real-world user problems
- Lead exploratory and regression testing for feature releases




- Investigate bugs, feedback, root causes, and potential solutions
- Expand LLM evaluation tools using production system metrics

Requirements:
- Five-plus years in a quality-focused role
- Ability to read and debug production code
- Experience writing maintainable tools for QA automation
- Ability to query millions of SQL rows for anomalies
- Solid communication and user-first product thinking

Bring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.

#J-18808-Ljbffr

📌 Quality Engineering Strategist Llm Systems (Toronto)
🏢 Blue J
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: quality engineering strategist llm systems (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: quality engineering strategist llm systems (toronto) / toronto