About the Role We are seeking a highly skilled

QA Automation Engineer with experience in emerging AI-powered applications. The ideal candidate will be responsible for developing test strategies, designing automation frameworks, validating AI-enabled features, and ensuring the quality of web, API, and backend systems. This role requires a strong background in automation testing, API validation, defect management, and collaboration across multiple workstreams.

Experience testing AI/LLM-powered applications, prompt behavior, or autonomous workflows is highly desirable.

Key Responsibilities - Develop and execute comprehensive test strategies, test plans, and test cases for web, API, backend, and AI-enabled applications.

- Design, build, and maintain scalable automation frameworks using Selenium, Playwright, Java, or Python.
- Create and execute automated test suites for functional, regression, integration, end-to-end, and API testing.
- Validate AI-powered features, including LLM responses, prompt behavior, AI workflows, and intelligent automation capabilities.
- Identify gaps, ambiguities, and risks in requirements and collaborate with stakeholders to drive resolution.




- Facilitate QA discussions across multiple teams and workstreams to ensure alignment on quality objectives and release readiness.
- Perform API testing using Postman and validate backend data using SQL queries.
- Manage defect triage processes, perform root cause analysis, and work closely with development teams to drive issue resolution.
- Create and maintain test execution cycles, dashboards, and quality metrics using JIRA, Confluence, and X-Ray.
- Participate in Agile ceremonies, sprint planning, backlog refinement, and release activities.
- Collaborate with developers, product owners, business analysts, and AI/ML teams to ensure high-quality software delivery.

Required Qualifications - 6+ years of experience in developing test strategies, test plans, and quality processes.

- Hands-on experience with automation frameworks using: Selenium and/or Playwright, and Java and/or Python
- Strong API testing experience using Postman, REST APIs, and backend validation.
- Experience using JIRA, Confluence, and X-Ray for test management and reporting.
- Robust understanding of Agile/Scrum delivery methodologies.
- Strong defect management and defect triage experience.

Role Details

- Location: Hybrid; Downtown Toronto
- Contract: 6 months contract with possibility of extension

📌 QA Automation Engineer (Toronto)
🏢 Socket.dev
📍 Toronto