Machine Learning Evaluation Specialist
Posted 1 Sep 2026
Machine Learning Evaluation Specialist (AI Training) About the Role What if your years of research and domain expertise could directly shape how the next generation of AI models th…
Labelbox’s expert network: per-project listings with published rates, weighted toward coding and language work.
Operated by
Labelbox
Work type
Per-project applications
Screening
AI interview + qualification tasks
Payouts
Weekly cycle
545 open Alignerr listings in the live feed, refreshed daily. The Alignerr link here, and the apply links marked as such, are referral links — Skillora may earn a fee at no cost to you, and it never affects what is shown. Official site: alignerr.com. Go to Alignerr
Filtering by rate hides per-task listings, which have no hourly equivalent.
Posted 1 Sep 2026
Machine Learning Evaluation Specialist (AI Training) About the Role What if your years of research and domain expertise could directly shape how the next generation of AI models th…
Posted 4 Sep 2026
German - Generalist Voice Actor (AI Training) About the Role What if your German voice could directly shape how AI speaks with millions of people around the world? We're looking fo…
Posted 3 Sep 2026
Voice Actor – German Speakers (AI Training) About the Role What if your voice could directly shape how AI communicates with millions of German speakers around the world? We're look…
Posted 28 Aug 2026
Professional Voice Actor – German (AI Training) About the Role What if your voice could directly shape how AI communicates with millions of German speakers around the world? We're…
Posted 7 Sep 2026
Robotics Simulation Engineer About the Role What if the physics simulations you build could teach the next generation of robots how to walk, grasp, and navigate the real world? We'…
Posted 4 Sep 2026
Scottish Voice Actor — AI Speech Recording Project About the Role What if your voice could directly shape how AI understands and communicates with millions of people? We're looking…
Posted 3 Sep 2026
Lean 4 Proof Engineer — Mathematical Formalization (AI Training) About the Role What if your deep mathematical expertise could directly shape how AI reasons, proves, and understand…
Posted 3 Sep 2026
French – Generalist Voice Actor (AI Training) About the Role What if your voice could directly shape how AI speaks to millions of French speakers around the world? We're looking fo…
Posted 3 Sep 2026
Voice Performer — Welsh English (AI Speech Training) About the Role What if your voice could directly shape how AI understands real human speech? We're looking for professional voi…
Posted 3 Sep 2026
Voice Actor / Voice-Over Artist — Australian English (AI Speech Project) About the Role What if your voice could directly shape how AI understands and speaks with millions of peopl…
Posted 3 Sep 2026
Applied Formal Methods Researcher (Lean 4) About the Role What if your deep mathematical training could directly shape how AI reasons about proofs — pushing the boundaries of what…
Posted 3 Sep 2026
Researcher — Lean 4 & Formal Proof Systems (AI Training) About the Role What if your deepest mathematical expertise could directly shape how AI understands and reasons about formal…
Posted 3 Sep 2026
Voice Actor – Italian Speakers (AI Training) About the Role What if your voice could directly shape how AI speaks to millions of Italian speakers around the world? We're looking fo…
Posted 3 Sep 2026
Voice Actor – French Speakers (AI Training) About the Role What if your voice could directly shape how AI speaks to millions of French speakers around the world? We're looking for…
Posted 2 Sep 2026
Voice Actor — Australian English (AI Speech Recording) About the Role What if your voice could directly shape how AI understands the way Australians talk? We're looking for profess…
Posted 2 Sep 2026
Voice Actor — UK English (AI Speech Training) About the Role What if your voice could directly shape how AI understands and communicates with millions of people? We're looking for…
Posted 2 Sep 2026
Voice Actor — Irish English (AI Speech Recording) About the Role What if your voice could directly shape how AI understands and communicates with millions of Irish English speakers…
Posted 2 Sep 2026
Voice Over Artist — Irish English (AI Speech Recording) About the Role What if your voice could directly shape how AI understands the way Irish people actually speak? We're looking…
Posted 2 Sep 2026
Voice Talent — UK English (AI Speech Training) About the Role What if your voice could directly shape how AI understands and communicates with millions of people? We're working wit…
Posted 2 Sep 2026
Welsh Voice Actor / Voice-Over Artist (AI Speech Recording) About the Role What if your Welsh voice could directly shape how AI understands the way real people in Wales speak? We'r…
Posted 2 Sep 2026
UK English Voice Actor — AI Speech Recording About the Role What if your voice could directly shape how AI understands and communicates with millions of people? We're working with…
Posted 2 Sep 2026
Scottish Voice Performer — AI Speech Recording (In-Studio) About the Role What if your Scottish accent could directly shape how AI understands and communicates with millions of peo…
Posted 2 Sep 2026
Voice Performer — Australian English (AI Speech Training) About the Role What if your voice could directly shape how AI understands and speaks to millions of people? We're looking…
Posted 2 Sep 2026
Formal Verification Scientist (Lean 4 & Mathlib) About the Role What if your deepest mathematical expertise could directly shape how AI understands and reasons about formal proof?…
Alignerr is Labelbox’s network for AI training work. Labelbox sells data infrastructure to AI labs, and Alignerr is how it recruits the humans those labs need: preference labeling, response evaluation, and expert reference answers across coding, language, STEM and professional domains.
It runs as a job board. Each project is its own listing with its own published rate, you apply to specific projects, and accepted work happens inside the Labelbox platform. That per-project structure is why Alignerr usually has one of the largest catalogues in this feed.
Pay runs on a weekly cycle. Headline expert rates reach $150 an hour; most contributors work standard tiers well below that, and both ends are visible on the listings.
$25–400
per hour, published range
$125/hr
median listing
100
live listings publishing a rate
Computed from Alignerr’s own published rates on the live feed, not from survey estimates.
Every Alignerr listing publishes a rate, usually as a range. Generalist projects post in the teens to twenties per hour, expert projects from the $30s up, with advertised specialist ceilings around $150. Pay periods run Monday to Sunday, paid out the following week.
The catalogue leans hard into software engineering and language work, with expert tracks in STEM, medicine and law. The bar sits between DataAnnotation and Mercor: a professional or academic background in your subject helps and gates the expert tiers, but generalist projects exist and accept strong writers.
Because applications are per project, persistence works differently here: not getting one project means little, and contributors typically apply across several listings until one converts.
Alignerr screens with a recorded AI interview plus qualification tasks per project. The interview covers your background and domain reasoning; the qualification tasks are short samples of the actual work, graded against the project rubric before you get paid access.
The two failure modes are familiar: talking in generalities during the interview instead of reasoning through specifics, and rushing qualification tasks that are graded on exactness. Both are practisable, and the interview format is the same one the rest of this market uses.
Further reading
Skillora runs the same format: a domain interview with an AI interviewer, followed by feedback on how you explained your reasoning. Take it as many times as you want before the one that counts.
Start a free practice interviewYes. Alignerr is operated by Labelbox, an established AI data company, and pays contributors on a weekly cycle for project work. As across this market, the real risks are operational: projects fill or pause quickly, qualification work is unpaid, and headline rates apply to a small expert tier rather than to most contributors.
Per project, with the rate on every listing. Generalist work posts in the high teens to twenties per hour; domain-expert projects post from the $30s upward; advertised specialist ceilings reach $150 an hour for scarce credentials. Community-tracked averages land in the $30s. The live cards above are the current truth.
A recorded conversation with an AI interviewer about your background and how you reason in your field, followed by project-specific qualification tasks. It is closer to Mercor’s screen than to a quiz: it scores explanation quality. Answer with specifics from real work, structure your reasoning aloud, and treat the qualification tasks as graded samples, because they are.
You work inside Labelbox’s platform on the project you applied to: labeling, ranking, writing or reviewing, against a rubric with reviewer feedback. Hours are flexible within project deadlines. When a project ends, you apply to the next one; tenure on one project makes the next application easier.
Moderately. It is easier to get into than Mercor, which filters on senior credentials, and harder than DataAnnotation, which has a single generalist gate. Expert tiers check degrees and professional history; generalist projects mostly check writing and rubric discipline. Applying to several projects at once is normal and improves odds.
Yes, like everywhere in this market. Per-project hiring means supply tracks lab demand: a strong month can be followed by a quiet one. The mitigation is the same as on Outlier: hold qualifications on multiple projects and platforms, and treat any single marketplace as one feed among several.