Test Setting Analyst

Location: Toronto, ON

Work-model: Hybrid, 2 days/week downtown Toronto

Contract: 6 Months (High likelihood of extension)

Main Deliverables

- Maintain, refresh, monitor, and optimize enterprise test environments.
- Execute non-functional testing including performance and accessibility testing.
- Develop and maintain Power BI dashboards, reporting, and environment metrics.
- Support test data management, data provisioning, and environment automation.
- Coordinate deployments, releases, and CI/CD activities across multiple teams.

Key Technical Skills (Prioritized )

- SQL Scripting
- Azure DevOps & CI/CD
- Power BI (Reporting, Dashboarding, Data Mapping)
- Performance Testing (JMeter preferred)
- Accessibility Testing (AODA)
- Test Data Management
- Data Mapping
- APIs / System Integrations

Technical Stack

- SQL Scripting
- Azure DevOps
- CI/CD Pipelines
- Power BI
- Data Mapping & Data Reporting
- Test Data Management
- API Testing & Integrations
- Performance Testing (JMeter preferred)
- Accessibility Testing (AODA Compliance)
- Environment Monitoring & Management
- Microsoft Copilot & AI-Assisted Automation
- Cloud / Hybrid / On-Prem Environments

Requirements

- 5+ years of experience in Test Environment Management, Infrastructure Support, Application Support, or related disciplines.
- Strong experience managing test environments, environment refreshes, deployments, troubleshooting, and monitoring.
- Advanced knowledge of Azure DevOps, Agile delivery practices, and CI/CD pipelines.
- Hands-on experience with SQL scripting for data extraction, validation, and reporting.
- Experience developing dashboards and reporting solutions using Power BI.




- Proven performance testing experience using tools such as JMeter.
- Knowledge of Accessibility Testing and AODA compliance requirements.
- Experience with test data management, test data provisioning, data mapping, and APIs.
- Strong understanding of application, database, infrastructure, and integration dependencies.
- Experience supporting cloud, hybrid, and on-premises environments.
- Experience creating automation solutions using Python, Power Query (M), AI-enabled tools, or Microsoft Copilot.
- Diploma or Degree in Computer Science, Information Technology, or equivalent experience.

Responsibilities

- Lead environment setup, maintenance, refreshes, patching, and troubleshooting activities.
- Coordinate environment bookings, releases, deployments, and production readiness activities.
- Monitor environment health, capacity, availability, performance metrics, and application version control.
- Maintain environment dependency maps and document configurations, integrations, and relationships.
- Identify environment conflicts, risks, bottlenecks, and optimization opportunities.
- Support infrastructure, platform services, cloud environments, and hybrid architecture.
- Manage and provision test data across multiple delivery teams.
- Create and maintain Power BI dashboards, operational metrics, and reporting solutions.
- Execute non-functional testing including performance, load, and accessibility testing.
- Support accessibility compliance monitoring, reporting, and remediation efforts.
- Build automation and reporting solutions using SQL, Python, Power Query, Microsoft Copilot, and other AI-enabled tools.
- Drive continuous improvement of Test Environment Management processes and standards.

📌 Test Environment Analyst - contract (Toronto)
🏢 Company
📍 Toronto