Remote Data Annotator (Edmonton)

Remote Data Annotator (Edmonton)

14 Nov
|
RemoExperts
|
Edmonton

14 Nov

RemoExperts

Edmonton

Remote Data Annotator (Full time, Remote)Rex.Zone helps candidates discover and apply to remote data annotator roles supporting modern AI/ML training pipelines. In this role, you will create labeled datasets and evaluation signals that improve training data quality and large language model performance across NLP, computer vision, and content safety workflows.What You Will DoApply detailed annotation guidelines to label and review text, images, audio, and multi-turn conversationsPerform LLM evaluation and prompt evaluation (helpfulness, harmlessness, factuality, reasoning quality)Complete RLHF-style preference labeling, rubric scoring, and critique writing to generate high-signal feedbackRun QA evaluation using sampling plans, inter-annotator agreement checks, and corrective actionsDocument edge cases, ambiguity, and rationale to improve rubrics, taxonomies, and consistencyFlag dataset issues (duplicates, leakage, label noise)



and follow confidentiality/data-handling standardsRequired QualificationsMid-to-senior experience in data annotation, data labeling, or QA evaluationStrong guideline compliance, consistency, and written reasoning for critique-based tasksComfort with structured labeling tools, taxonomies, and metrics-driven remote workFamiliarity with NLP/LLM evaluation or content moderation taxonomiesPreferredRLHF workflows, preference ranking, and rubric-based scoring experienceComputer vision annotation exposure (bounding boxes, polygons, segmentation QA)Understanding of training data quality concepts (bias, representativeness, label noise)CompensationBase hourly rate: $30-$50/hr (USD), depending on project needs and qualifications.

📌 Remote Data Annotator (Edmonton)
🏢 RemoExperts
📍 Edmonton

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: remote data annotator (edmonton) / edmonton

Subscribe to this job alert:

Get the latest job offers by email for: remote data annotator (edmonton) / edmonton