About the Role

We are seeking a highly skilled

QA Automation Engineer with experience in emerging AI-powered applications. The ideal candidate will be responsible for developing test strategies, designing automation frameworks, validating AI-enabled features, and ensuring the quality of web, API, and backend systems.

This role requires a strong background in automation testing, API validation, defect management, and collaboration across multiple workstreams.

Experience testing AI/LLM-powered applications, prompt behavior, or autonomous workflows is highly desirable.

Key Responsibilities

Develop and execute comprehensive test strategies, test plans, and test cases for web, API, backend, and AI-enabled applications.

Design, build, and maintain scalable automation frameworks using Selenium, Playwright, Java, or Python.

Create and execute automated test suites for functional, regression, integration, end-to-end, and API testing.

Validate AI-powered features, including LLM responses, prompt behavior, AI workflows, and intelligent automation capabilities.

Identify gaps, ambiguities, and risks in requirements and collaborate with stakeholders to drive resolution.





Facilitate QA discussions across multiple teams and workstreams to ensure alignment on quality objectives and release readiness.

Perform API testing using Postman and validate backend data using SQL queries.

Manage defect triage processes, perform root cause analysis, and work closely with development teams to drive issue resolution.

Create and maintain test execution cycles, dashboards, and quality metrics using JIRA, Confluence, and X-Ray.

Participate in Agile ceremonies, sprint planning, backlog refinement, and release activities.

Collaborate with developers, product owners, business analysts, and AI/ML teams to ensure high-quality software delivery.

Required Qualifications

6+ years of experience in developing test strategies, test plans, and quality processes.

Hands-on experience with automation frameworks using: Selenium and/or Playwright, and Java and/or Python

Strong API testing experience using Postman, REST APIs, and backend validation.

Experience using JIRA, Confluence, and X-Ray for test management and reporting.

Robust understanding of Agile/Scrum delivery methodologies.

Strong defect management and defect triage experience.

Role Details

Location: Hybrid; Downtown Toronto

Contract: 6 months contract with possibility of extension

📌 QA Automation Engineer (Toronto)
🏢 Socket.dev
📍 Toronto