207 new jobs this week

AI Evaluation Rubric Auditor

Posted 16 Nov 2026

$60–85/hr

Apply

Platform

Mercor

Work

Remote · Contract · 15 hrs/wk

Experience

Mid level

Eligibility

Open to Canada, United States, Argentina, Bolivia, Brazil, Chile, Colombia, Ecuador, Guyana, Paraguay, Peru, Uruguay, United Kingdom

Field

Data & machine learning

Skills

LLM EvaluationEvaluation Rubric DesignRubric AuditingAI Agent TestingAgent Transcript AnalysisData Verification

About this role

The work We are testing AI agents on realistic shopping and delivery tasks. Your role as a Project Auditor is to audit the work done by our Project Reviewers. You will audit complete tasks (prompt and grading rubric) and determine if their rubric failures are fair: - Was the…

Read the full description on Mercor

Disclosure: Skillora is independent of Mercor. The apply button carries our referral code, and if you are placed, Mercor pays Skillora a fee. It does not change what you are paid. If Mercor asks you to confirm a referrer, it is Skillora’s founder.