Cricket Fan – Live T20I Match AI Evaluator (India)

Role overview

Mercor is looking for India-based people with strong cricket knowledge to evaluate AI assistants live, while real international T20 matches are being played. On scheduled match days, you'll ask AI assistants the questions you'd naturally ask while following a match, then rate how helpful, accurate, and well-presented their answers are. Your judgments directly shape how AI products serve sports fans.

What you'll do

• Follow India's live T20I matches and ask AI assistants real fan questions: live scores and win probability, player and team stats, rules (DRS, powerplays, Duckworth-Lewis), schedules and broadcasts, highlights, and expert-style analysis
• Run the same question on two AI products side by side, either as a single question or as a multi-turn conversation of 2 to 10 turns
• Capture share links and full screenshots of every conversation
• Rate each response for helpfulness, factual accuracy, and presentation, choose which product did better, and write a clear rationale for your choice

What we're looking for

• Based in India
• At least 1 year of professional work experience
• Solid cricket knowledge: rules, teams, players, and how T20 international cricket works
• Being an avid cricket fan who follows the Indian national team is a plus
• Available to work live during the match window on scheduled match days
• Comfortable using AI chat assistants and web search
• Strong written English, sharp attention to detail, and the ability to spot factual errors
• Prior AI rating or evaluation experience is a plus, but not required

Details

• Event-based: work happens live on India T20I match days
• Match 1: India vs West Indies T20I on October 9
• Match 2: India vs Sri Lanka T20I on December 22
• Each task takes about 2 to 2.5 hours and is completed while the match is live

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.