Own quality for Nexxa AI agents through Python automation and exploratory testing across industrial systems and operational scenarios. As a Senior or Staff SDET, you will build production-grade evaluation harnesses, simulators, regression suites, and CI/CD quality gates. You will test LLM-based agents across planning, tool selection, execution, recovery, and final outputs. The work combines API, contract, integration, end-to-end, performance, and reliability testing with manual trace review, red-teaming, and release verification. Key Responsibilities:

Build evaluation harnesses and regression suites for LLM-based agents Integrate automated evaluations into CI/CD quality gates Develop simulators, mocks, and sandbox environments for industrial tools Review traces,



outputs, and agent behavior manually Turn failures and attacks into reproducible automated tests Requirements:

Five-plus years in SDET, QA, or software engineering Robust Python programming and software engineering practices Manual and automated testing experience for distributed systems Experience with CI/CD, Docker, and Kubernetes Experience testing APIs, microservices, and LLM-based products Apply your automation, evaluation, and exploratory testing expertise to Nexxa’s high-stakes industrial AI systems.

📌 Senior AI Agent Test Automation Engineer (Toronto)
🏢 Nexxa
📍 Toronto