Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Network, we combine deep expertise in AWS, artificial intelligence, and Anthropic’s Claude platform to help customers modernize their technology, build intelligent products, and move AI from experimentation into production.

Our capabilities span generative and agentic AI, cloud migration and modernization, cloud-native application development, data and analytics, DevOps, managed services, security and compliance, and customer experience transformation. At Caylent, our people always come first.

We are a fully remote global company with employees in Canada, the United States and Latin America. We celebrate the culture of each of our team members and foster a community of technological curiosity. Come talk to us to learn more about what it means to be a Caylien!

Your Assignment

Design and execute test strategies for Amazon Connect implementations covering contact flows, routing logic, IVR/self-service, Cases/Tasks workflows, and Contact Lens configurations

Build test plans that validate AI agent behavior: intent recognition accuracy, escalation paths, barge-in/fallback handling, hallucination guardrails, and multilingual/SSML voice interactions

Validate legacy-to-Connect migrations (i.e. Avaya, Genesys, Connect, NICE) through parallel-run testing, flow conversion verification, and data migration validation

Define and track quality metrics (defect density, test coverage, escape rate) and report on release readiness to delivery leads and customer stakeholders

Hands-on experience with web application and web automation testing

Manual, Automated & Full-Stack Testing

Build, maintain, and execute manual and automated IVR test suites, using tools such as Cyara, Hammer, or Botium (preferred).

Build, maintain, and execute manual and automated web application test suites, using frameworks such as Cypress, Selenium, or Playwright (preferred).

Build and maintain manual and automated test suites: Playwright E2E and API tests, Cypress, Selenium, integration tests against live Amazon Connect instances, and end-to-end tests of Amazon connect call flows.

Validate serverless, event-driven backends (Lambda, EventBridge, Step Functions, SQS/SNS, DynamoDB, Kinesis) with integration and contract tests

Production Readiness & Operations





Execute phased rollout and cutover validation for live contact centers, where testing gaps translate directly into missed calls and customer impact

Verify monitoring and alerting coverage (CloudWatch metrics, alarms, dashboards) across voice, chat, tasks, queues, agents, Lambda, and AI agents prior to go-live

Participate in production incident triage, reproducing defects and validating fixes across the contact center stack

Perform security and compliance validation: least-privilege IAM checks, DevSecOps scan review, and encryption standard verification

Partner with engineers during development to shift testing left: pairing on test design, reviewing acceptance criteria, and flagging risk areas early

Run UAT sessions with customer stakeholders, triage findings, and drive defects to resolution ahead of production cutovers

Contribute reusable test assets (automated suites, test data sets, QA checklists) back to the CXE practice

Mentor junior QA engineers on contact center testing patterns and Caylent's quality standards

Your Qualifications

8+ years of QA/test engineering experience, including 3+ years testing contact center, CCaaS, or IVR/voice platforms

Hands-on experience with Amazon Connect or a comparable CCaaS platform: contact flows, routing, Cases/Tasks, and reporting

Proficiency with automated testing frameworks (Playwright E2E and API tests, Cypress, Selenium) for unit, integration, and E2E testing

Experience testing serverless/event-driven AWS architectures (Lambda, API Gateway, DynamoDB, Step Functions)

Working knowledge of conversational AI / voice testing considerations: intent accuracy, latency, fallback behavior

Strong defect documentation and triage skills; comfortable running UAT sessions with business and technical stakeholders

Familiarity with CI/CD pipelines (GitHub Actions) and integrating automated tests into deployment workflows

Preferred Qualifications

Contact center migration testing experience (i.e. Avaya, Genesys, Connect, NICE)

Experience with AI observability/trace validation (agent spans,



token/cost attribution) or accessibility engineering

AWS certifications (Solutions Architect, Developer, or ML/Connect-relevant Specialty)

Contact center operations fluency: Quality management, outbound compliance, and CX KPIs

Consulting or client-delivery background

Hands on experience with Cyara Botium

Medical Insurance for you and eligible dependents

Generous holidays and flexible PTO

Paid for exams and certifications

Peer bonus awards

State of the art laptop and tools

Equipment & Office Stipend

Annual stipend for Learning and Development

Work with an amazing worldwide team and in an incredible corporate culture

NOTE: This position requires current legal authorization to work in the country where this position is located. Caylent is not able to sponsor visa or work permit applications at this time.

At Caylent, we are committed to fair, transparent, and inclusive hiring practices. As part of our recruitment process, we may use artificial intelligence (AI) tools or automated systems to assist with the screening and evaluation of applications to help match candidate qualifications with job requirements.
These tools are designed to support — not replace — human decision-making. Final hiring decisions are always made by our trained recruitment professionals.
If an AI or automated tool is used during your application process, it will only be in accordance with applicable laws and regulations, and your information will be handled in a secure and confidential manner.
If you have any questions, please contact [email protected]

Caylent is a place where everyone belongs. We celebrate diversity and are committed to creating an inclusive workplace for all employees. Our approach helps us to build a winning team that represents a variety of backgrounds, perspectives, and abilities. So, regardless of how your diversity expresses itself, you can find a home here at Caylent.

We are proud to be an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, religion, national origin, sex (including pregnancy), sexual orientation, gender identity, gender expression, age, veteran status, genetic information, disability, or other applicable legally protected characteristics. If you would like to request an accommodation due to a disability, please contact us at [email protected].

#J-18808-Ljbffr

📌 Senior QA Engineer (Manitoba)
🏢 Caylent
📍 Manitoba