Study Domain Expert — Judge Calibration — Sales

Role Overview

Mercor is sourcing Sales experts for a structured judge-calibration study. You will apply professional judgment to realistic Sales work and evaluate model-generated outputs.

What You'll Do

• Sign an NDA before receiving study materials.
• Complete one realistic Sales task using supplied source files.
• Review model outputs, rank and score them, and write evidence-based rationales.
• Provide structured feedback on the task and study design.

Time Commitment 13 hours during September 12–15, 2026.

Quality Criteria

• More than 5 years of experience in Sales or a closely relevant field, ideally at a high-caliber firm.
• Ideally held a manager, director, or principal-level Sales role; entry-level experience alone is insufficient.
• Fluent or native English.
• Prior work as an expert is a plus.
• No geographic restrictions.

Study Conditions and Eligibility

• No use of LLMs or other AI assistants during the study.
• People who have worked on Project Alchemy in any capacity or accessed its source-world data are not eligible.