Drive quality assurance at Appnovation as a Senior AI Evaluation Engineer. Engage in extensive evaluations to improve AI response accuracy and effectiveness. As part of the Appnovation team, you will utilize your 4+ years of experience in QA and software testing to analyze and enhance AI performance. In this role, you will focus on creating and implementing rigorous evaluation frameworks, ensuring that our AI systems meet high standards of factual accuracy and reliability. Key Responsibilities:

- Execute evaluations at scale for large datasets
- Measure improvements in answer quality quantitatively
- Develop a cohesive metrics framework to track progress
- Automate testing processes and integrate them with CI/CD
- Collaborate effectively across teams to resolve issues

Requirements:

- Bachelor’s Degree in a technical discipline or equivalent
- 4+ years of QA/test experience, ideally in data/Machine Learning
- Robust background in Python and statistical analysis
- Experience with evaluation frameworks in AI
- Detail-oriented with excellent communication skills

Be at the forefront of AI evaluation, improving accuracy for better digital solutions at Appnovation.

📌 Senior AI Evaluation and QA Engineer (Montreal)
🏢 Appnovation Technologies
📍 Montreal