Position:LLM – AI Quality Analyst (Personalization) – KoreanType:Short-Term Contract (2 months)Compensation:$11 per hourLocation:Remote (Global)Commitment:Part-time availability requiredRole ResponsibilitiesEvaluate a personalization feature for GeminiDesign and execute multi-turn conversational prompts that require the AI to utilize personal information and experiencesAssess how effectively the model uses past conversations and activity to generate relevant and helpful responsesEvaluate model responses based on intent and appropriate personalizationAnalyze responses for grounding issues,



including flawed inferences or hallucinationsAssess integration quality to ensure personal data is incorporated naturally into responsesPerform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalnessWrite clear rationales referencing specific conversation turnsExtract and verify debug information to confirm correct use of summaries and data sourcesMaintain data hygiene by deleting evaluation conversations after completionRequirementsExperience in data annotation, AI quality evaluation, content moderation, or related rolesStrong Korean proficiency (reading and writing)Willingness to use a primary personal Google account and enable personal data sources for assessmentStrong analytical thinking and attention to detailExperience with creative prompt engineering and personalization conceptsAbility to provide structured feedback and clear written explanationsAbility to work independently in a remote workplace#J-18808-Ljbffr

📌 Quality Specialist (Korean) | $11/Hr Remote - $11 An Hour - Part Time - Remote (Winnipeg)
🏢 Crossing Hurdles
📍 Winnipeg