AI Developer Trace Task Auditor
Posted 28 Aug 2026
$70–90/hr
ApplyWork
Remote · Contract · 40 hrs/wk · Remote — United States
Experience
3+ years
Eligibility
USA
Field
Software engineering
Skills
About this role
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
Disclosure: Skillora is independent of Mercor. The apply button carries our referral code, and if you are placed, Mercor pays Skillora a fee. It does not change what you are paid, our ranking does not know which listings pay us, and selection is decided by Mercor’s own vetting.