Job Title: Quality Assurance Specialist

Location: Toronto, ON (2-4 days Hybrid)

Employment Type: Contract

Experience: 10+ years in QA, including 2 years of experience testing AI/ML-based applications

Required Skills

- Strong experience in software QA and test automation.
- Proficiency in Python or Java and automation frameworks such as Selenium.
- Experience with API testing and RESTful services.
- Understanding of AI/ML concepts, model validation, and data quality testing.
- Familiarity with Generative AI, LLMs, prompt testing, and response evaluation.
- Experience with test management and defect-tracking tools such as Jira.
- Knowledge of SQL and database testing.
- Solid analytical, problem-solving, and communication skills.

Preferred Qualifications
- Experience testing applications built using OpenAI APIs, Azure OpenAI, or similar AI platforms.
- Familiarity with RAG (Retrieval-Augmented Generation), vector databases, and embeddings.
- Exposure to AI evaluation frameworks such as Ragas, DeepEval, or promptfoo.
- Experience with CI/CD pipelines and Git.
- Knowledge of cloud platforms such as AWS, Azure, or GCP.

📌 Quality Assurance Specialist (Toronto)
🏢 apptoza
📍 Toronto