207 new jobs this week

AI Evaluation Rubric Reviewer

Posted 16 Nov 2026

$40–75/hr

Apply

Platform

Mercor

Work

Remote · Contract · 15 hrs/wk

Experience

Mid level

Eligibility

Open to United States, Canada, United Kingdom, Austria, Belgium, Bulgaria, Croatia, Cyprus, Czechia, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden

Field

Data & machine learning

Skills

LLM EvaluationEvaluation Rubric DesignAI Agent EvaluationTranscript AnalysisData Validation

About this role

The work We are testing AI agents on realistic shopping and delivery tasks. You'll review AI-drafted tasks (prompt, grading rubric) along with model attempts, and decide whether each failure is fair: - Was the information available? - Does the rubric accurately grade what the…

Read the full description on Mercor

Disclosure: Skillora is independent of Mercor. The apply button carries our referral code, and if you are placed, Mercor pays Skillora a fee. It does not change what you are paid. If Mercor asks you to confirm a referrer, it is Skillora’s founder.