Senior Software Engineer – AI Evaluation
Build the systems that measure AI intelligence. Senior engineers — shape how we evaluate cutting-edge AI, fully remote and flexible....
Expert gig work training and evaluating AI models, aggregated from the marketplaces that actually pay for it.
1,347 open listings across 6 marketplaces, refreshed daily.
Filtering by rate hides per-task listings, which have no hourly equivalent.
108 listings
Clear filtersBuild the systems that measure AI intelligence. Senior engineers — shape how we evaluate cutting-edge AI, fully remote and flexible....
Seeking backend development experts to create, review, and refine high-quality UI coding problems and solutions, ensuring rigor and accuracy in evalua...
Put your statistics expertise to work shaping frontier AI. Flexible, remote, and well-compensated for experts in probability, inference, and experimen...
Turn your forecasting instincts into impact. Help shape smarter AI by predicting real-world events with structured, probabilistic reasoning....
Turn complex clinical data into decisions that improve patient outcomes. Bring your healthcare analytics expertise to a fully remote, high-impact cont...
Get paid $50–$75/hr to build AI infrastructure that powers the world's leading models. Senior Python engineers wanted — fully remote and high-impact....
Get paid $50–$75/hr to build AI data pipelines at the frontier. Senior Python engineers wanted — fully remote, flexible contract....
Get paid $50–$75/hr to build AI infrastructure that matters — Python engineers wanted for real-world pipelines at leading AI labs. Fully remote....
Put your PhD or Masters to work shaping the future of AI — solve complex, real-world problems for the world's leading research labs. Remote and flexib...
Get paid $60–$80/hr to teach AI how to think. Senior ML experts wanted — shape the reasoning behind next-gen models, fully remote....
Get paid to teach AI how to think — use your ML expertise to shape the reasoning behind next-gen models. Remote, flexible, and highly competitive pay....
Get paid $60–$80/hr to teach AI how to think. Use your ML expertise to shape how the world's most advanced models reason and make decisions....
Get paid to do chores — and help build the robots that will eventually do them for you. Flexible, remote-friendly AI training role....
Put your data science expertise to work training the world's most advanced AI — fully remote, flexible, and paying up to $80/hr....
Get paid up to $80/hr to challenge and improve cutting-edge AI — put your data science expertise to work shaping the future of machine learning....
Put your econometrics expertise to work shaping the future of AI. Flexible, remote contract with competitive pay....
Get paid to shape the future of AI — no experience needed. Flexible remote contract, up to $120/hr....
Get paid to shape how AI sees the world — describe images from anywhere. No experience needed, flexible hours....
Get paid to shape the future of AI shopping — review and classify product data from anywhere. No e-commerce experience required....
Turn your sharp eye into AI impact. Describe images that teach machines to see — flexible, remote, no experience needed....
Get paid to challenge AI — craft clever prompts that push the limits of machine reasoning. Fully remote, no tech background needed....
Get paid to shape the future of AI — label, tag, and annotate data from anywhere. No experience needed, flexible hours....
Get paid to put your local knowledge to work — help shape how AI understands the real world, one location at a time. Fully remote....
Get paid to help make AI safer and fairer. Use your critical thinking to shape ethical AI — fully remote, flexible, no AI background needed....
AI labs need domain experts to write, review and grade the material their models learn from. A radiologist checks a diagnostic explanation, a tax accountant writes the reasoning behind a filing, a backend engineer builds a test environment an agent has to solve. That work is bought through a handful of specialist marketplaces, it is almost always remote, and it is almost always paid by the hour or by the task.
The problem is that the work is scattered. Each marketplace runs its own board, its own titles and its own pay conventions, so finding the roles that fit you means checking six sites and mentally converting between them. This page collects the listings into one feed with one set of filters, refreshed daily, and links each one straight through to the marketplace that posted it.
Search by skill, filter by pay, commitment or experience level, and see every marketplace side by side instead of one board at a time.
Every listing links to the original posting. You apply, onboard and get paid by them directly. Skillora does not sit between you and your earnings.
Most of these marketplaces screen with a recorded or live interview. Run the same interview with Skillora first and get feedback on your answers.
Write and review code, build agent environments, grade model output.
Evaluation design, dataset curation and reinforcement-learning work.
Clinical reasoning, diagnostic review and medical exam authoring.
Contract analysis, case reasoning and jurisdiction-specific review.
Modelling, valuation walkthroughs and accounting treatment review.
Translation, transcription, speech recording and native-fluency review.
Physics, chemistry and biology problem authoring and verification.
Consulting cases, operations workflows and process documentation.
Every listing links back to the marketplace that published it. You apply, onboard and get paid by them directly.
Expert contract work across medicine, law, finance and engineering, mostly hourly and often at the top of the rate range.
See Mercor listings
AI-vetted talent network placing engineers and domain specialists on model-training projects.
See micro1 listingsLarge catalogue of AI training roles, heavily weighted towards software engineering and language work.
See Alignerr listingsDomain verticals with published rates, covering coding, maths, writing and specialist subjects.
See Outlier listings
Task-based annotation and model-response review, with an accessible entry path for new contributors.
See DataAnnotation listingsPaid expert studies and evaluation projects, priced per approved study rather than hourly.
See Terac listingsIt is paid work producing or evaluating the data that AI models learn from. In practice that means writing expert answers in your own field, grading model output against a rubric, building coding or tool environments for an agent to solve, recording speech, or reviewing another contributor’s work. It is contract or task-based rather than salaried, and the marketplaces that buy it recruit for specific domains rather than for general labelling.
Rates vary far more than in a normal job market because they track scarcity of expertise, not seniority. General contributor work sits in the $15 to $30 per hour range. Specialist domains such as medicine, law, quantitative finance and senior software engineering routinely post between $60 and $150 per hour, and some expert roles go higher. Some work is priced per task instead of hourly, in which case we show the task fee as published rather than inventing an hourly equivalent.
Usually not. These roles hire for depth in a subject, not for ML skills, because the whole point is to get expertise into the model that the model does not already have. A practising lawyer or a cardiologist is a stronger candidate for a domain role than a generalist who knows how transformers work. Software engineering roles are the exception, since the work itself is writing and reviewing code.
Almost always. The overwhelming majority of listings in this feed are fully remote and asynchronous, which is why they suit contractors, people between roles and anyone doing this alongside another job. Where a listing states a country restriction we show it on the card, and where it states none we say so plainly rather than claiming it is open worldwide.
Mercor, micro1, Alignerr, Outlier, DataAnnotation and Terac. These are the platforms that publish expert AI-training work openly. We refresh the feed once a day and keep listings that have closed accessible, marked as no longer listed, so a link you saved never dies silently.
No. Browsing and applying are free, and you are never asked for an account to see a listing. Where a marketplace runs a referral programme, Skillora may earn a fee if you sign up and work through our link. It costs you nothing, we say so on every listing where it applies, and it has no effect on how listings are ranked. The ranking code has no knowledge of which sources pay.
Every marketplace screens before assigning work, most of them with an interview that is recorded or run by an AI interviewer, followed by a paid trial task. The screen is the part most candidates underestimate: it is where you have to explain your reasoning out loud in your own domain. Practising that specific format is the single highest-leverage thing you can do before applying.
The screen is usually a recorded or live interview in your own domain, followed by a paid trial task. Run that interview with Skillora before you take the real one and get feedback on how you explained your reasoning, not just on what you said.
Practise the screen free