- Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics.
- Design and assess comprehensive test cases for functional, regression, and edge-case scenarios.
- Review bug reports and test documentation to ensure issues are reproducible and severity is properly assessed.
- Identify, isolate, and document defects with accurate reproduction steps.
- Provide detailed, actionable written feedback and annotations to support efficient resolution by developers.
- Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards.
Requirements
- Proven professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or similar role.
- Strong command of QA fundamentals, including test case design, bug tracking, and both manual and automated testing strategies.
- Hands-on experience with automation frameworks and test management tools such as Selenium, Playwright, Cypress, or similar.
- Prior paid human data experience supporting AI training, such as annotation, labeling, or AI response evaluation.
- Excellent analytical and problem-solving skills with meticulous attention to detail.
- Ability to communicate complex findings clearly in written English.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage