Legal Evaluation Specialist

Role Title: Legal Evaluation Specialist

Role Type: Contractor

Location: Remote

micro1 is engaging Legal Evaluation Specialists to contribute to a customer's innovative project focused on evaluating and enhancing advanced AI models within the legal domain. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

1. Develop original, high-difficulty legal question-and-answer pairs targeting complex issues in statute, precedent, doctrine, and legal reasoning to rigorously assess AI performance.
2. Research, source, and meticulously verify answers using primary legal materials, providing clear citations and thorough documentation of your analysis.
3. Construct questions demanding nuanced legal interpretation, synthesis across authorities, or real-world application — going beyond simple fact recall.
4. Evaluate AI-generated responses to your questions, iterating on content to ensure each prompt remains challenging and legally robust.
5. Maintain exceptional clarity and precision in wording, ensuring that questions are unambiguous and answers are legally sound.
6. Incorporate reviewer feedback and adhere to project guidelines and quality benchmarks to consistently produce outstanding deliverables.

Preferred Qualifications

1. JD, law student, or background as a legal professional with demonstrated expertise in legal research and analysis.
2. Proven ability to locate, interpret, and synthesize information from primary legal sources and authorities.
3. Exceptional attention to detail and mastery of concise, precise written English (fluency required; native proficiency not necessary).
4. Talent for designing insightful, challenging, and well-structured legal questions and scenarios.
5. Experience working independently, demonstrating reliability and initiative in a remote project setting.
6. Strong analytical mindset, capable of assessing complex legal arguments and identifying nuances in interpretation.
7. Prior experience with AI training or evaluation is advantageous but not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.