MercorPosted 4 Aug 2026

In-House Counsel (Australia)

Apply on Mercor

Pay

$100–120/hr

Work

Remote · Contract · Australia (remote)

Experience

5+ years

Eligibility

AUS

Field

Law

Skills

Australian LawCommercial LawContract LawIn-House Legal CounselAI EvaluationLarge Language ModelsRubric-Based Evaluation

Disclosure: Skillora is independent of Mercor. The apply button carries our referral code, and if you are placed, Mercor pays Skillora a fee. It does not change what you are paid, our ranking does not know which listings pay us, and selection is decided by Mercor’s own vetting.

About this role

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.

What you'll do

  • Run the same set of prompts across two AI (LLM) platforms
  • Compare the outputs from both platforms side by side
  • Score each response against a standardized rubric we provide
  • Submit concise written feedback for every evaluation

Requirements

  • 5+ years as in-house legal counsel practising in Australia
  • Strong command of Australian law, especially commercial and contract matters
  • Sharp attention to detail and precise written English
  • Able to work independently to a rubric and to deadlines

Logistics

  • Initial commitment: ~10 hours, with strong potential for more
  • Confidentiality: all work is covered by NDA

Similar AI training jobs

All AI training jobs