Be at the forefront of assessing AI coding interactions. We're looking for detail-oriented QA experts to evaluate AI capabilities through remote, task-based engagement.
In this position, you will rigorously review transcripts between users and AI coding systems, applying your skills in testing and documentation. The role suits senior or staff engineers, QA specialists, or documentation experts who can provide critical insights into AI performance and user experience.
Key Responsibilities:
• Analyze full transcripts of user-AI conversations
• Score dialogues with a comprehensive rubric
• Write justifications for given scores
• Detect inconsistencies in AI execution
• Review multiple transcripts accurately within time limits
Requirements:
• Extensive experience in code review or QA methodologies
• Proficiency in Python and familiarity with various programming languages
• Strong technical writing and documentation skills
• Background in development, DevOps, or system analysis preferred
• Ability to work independently with versatile scheduling
Enhance the quality of AI development by leveraging your analytical expertise in this innovative evaluation role.
#J-18808-Ljbffr
Apply on Kit Job: kitjob.ca/job/2fsmyx
📌 Remote Role: QA Engineer for AI Development Assessment (Ottawa)
🏢 YO IT CONSULTING
📍 Ottawa
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.