What roles fall under data and ML in AI training work?+
Evaluation design, dataset curation, quality auditing of labeled data, red-teaming, error analysis on model outputs, and reviewer roles that oversee other contributors. Titles vary by marketplace: Outlier calls some of this "quality management", Mercor posts it as evaluation and research roles, Alignerr as expert review. The common thread is judging data and model behavior rather than producing domain content.
How much does this work pay?+
Published rates mostly sit between $30 and $80 an hour, above generalist annotation and below scarce-specialist domains like medicine. Reviewer and evaluation-design roles pay more than labeling because they gate everyone else’s output. Per-task pricing is rare here; nearly all listings are hourly.
What background gets you hired?+
Working experience with ML systems: data science, ML engineering, analytics or research. A PhD helps for research-adjacent roles but is not the filter; the screens test whether you can spot bad labels, write an unambiguous rubric, and explain why a metric is misleading. Portfolio evidence, a Kaggle history, published analysis or production ML work, moves applications faster than credentials.
How is this different from data annotation?+
Annotation is producing labels; this category is deciding what should be labeled, how, and whether the result is any good. Annotation pays less and scales to more people. Data and ML roles are fewer, better paid, and screened harder, usually with an assessment that hands you messy real data and asks what is wrong with it.
Which marketplaces post the most data and ML work?+
Mercor and micro1 post matched contract roles for data scientists and ML engineers. Outlier and Alignerr run continuous evaluation and reviewer tracks. Terac runs paid expert studies with ML practitioners. The mix shifts weekly, which is why the feed above is worth checking rather than any single board.
Is the Mercor data scientist talent network a real job?+
It is a standing applicant pool, not an open project. Mercor screens data scientists with its AI interviewer and holds them until a lab needs graders for statistical modelling, A/B test write-ups or ML pipelines. The listing itself says there is no immediate opening, and you are paid only once matched. Apply anyway if you fit the profile: the interview is done once and the match can arrive weeks later. If you want paid hours sooner, the micro1 data scientist contract has a fixed rate and a set number of seats, and the Data Scientist section on this page shows whichever of the two is open.