Role overview

Mercor is looking for India-based people with strong cricket knowledge to evaluate AI assistants live, while real international T20 matches are being played. On scheduled match days, you'll ask AI assistants the questions you'd naturally ask while following a match, then rate how helpful, accurate, and well-presented their answers are. Your judgments directly shape how AI products serve sports fans.

What you'll do

Follow India's live T20I matches and ask AI assistants real fan questions: live scores and win probability, player and team stats, rules (DRS, powerplays, Duckworth-Lewis), schedules and broadcasts, highlights, and expert-style analysis

Run the same question on two AI products side by side, either as a single question or as a multi-turn conversation of 2 to 10 turns

Capture share links and full screenshots of every conversation

Rate each response for helpfulness, factual accuracy, and presentation, choose which product did better, and write a clear rationale for your choice

What we're looking for

Based in India

At least 1 year of professional work experience

Solid cricket knowledge: rules, teams, players, and how T20 international cricket works

Being an avid cricket fan who follows the Indian national team is a plus

Available to work live during the match window on scheduled match days

Comfortable using AI chat assistants and web search

Strong written English, sharp attention to detail, and the ability to spot factual errors

Prior AI rating or evaluation experience is a plus, but not required

Details

Event-based: work happens live on India T20I match days

Match 1: India vs West Indies T20I on October 9

Match 2: India vs Sri Lanka T20I on December 22

Each task takes about 2 to 2.5 hours and is completed while the match is live

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.