Own quality for Nexxa AI agents through Python automation and exploratory testing across industrial systems and operational scenarios.
As a Senior or Staff SDET, you will build production-grade evaluation harnesses, simulators, regression suites, and CI/CD quality gates. You will test LLM-based agents across planning, tool selection, execution, recovery, and final outputs. The work combines API, contract, integration, end-to-end, performance, and reliability testing with manual trace review, red-teaming, and release verification.
Key Responsibilities:
- Build evaluation harnesses and regression suites for LLM-based agents
- Integrate automated evaluations into CI/CD quality gates
- Develop simulators, mocks, and sandbox environments for industrial tools
- Review traces,
outputs, and agent behavior manually
- Turn failures and attacks into reproducible automated tests
Requirements:
- Five-plus years in SDET, QA, or software engineering
- Robust Python programming and software engineering practices
- Manual and automated testing experience for distributed systems
- Experience with CI/CD, Docker, and Kubernetes
- Experience testing APIs, microservices, and LLM-based products
Apply your automation, evaluation, and exploratory testing expertise to Nexxa’s high-stakes industrial AI systems.
📌 Senior AI Agent Test Automation Engineer (Toronto)
🏢 Nexxa
📍 Toronto