MercorPosted 4 Aug 2026
In-House Counsel (Australia)
Pay
$100–120/hr
Work
Remote · Contract · Australia (remote)
Experience
5+ years
Eligibility
AUS
Field
Law
Skills
Australian LawCommercial LawContract LawIn-House Legal CounselAI EvaluationLarge Language ModelsRubric-Based Evaluation
About this role
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
What you'll do
- Run the same set of prompts across two AI (LLM) platforms
- Compare the outputs from both platforms side by side
- Score each response against a standardized rubric we provide
- Submit concise written feedback for every evaluation
Requirements
- 5+ years as in-house legal counsel practising in Australia
- Strong command of Australian law, especially commercial and contract matters
- Sharp attention to detail and precise written English
- Able to work independently to a rubric and to deadlines
Logistics
- Initial commitment: ~10 hours, with strong potential for more
- Confidentiality: all work is covered by NDA
Similar AI training jobs
Litigation Lawyer (Australia)
MercorPosted 14 Aug 2026
$100–120/hrRemote · Contract · Australia (remote)AUS
Corporate/M&A Lawyer (Australia)
MercorPosted 14 Aug 2026
$100–120/hrRemote · Contract · Australia (remote)AUS
In-House Counsel (United Kingdom)
MercorPosted 4 Aug 2026
$150–160/hrRemote · Contract · United Kingdom (remote)GBR
In-House Counsel (Germany)
MercorPosted 4 Aug 2026
$140–150/hrRemote · Contract · Germany (remote)DEU