Senior Software Engineer - Pairwise Evaluation
Build the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
Expert gig work training and evaluating AI models, aggregated from the marketplaces that actually pay for it.
1,347 open listings across 6 marketplaces, refreshed daily.
Filtering by rate hides per-task listings, which have no hourly equivalent.
989 listings
Clear filtersBuild the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
Get paid to break AI. Use your security expertise to probe, test, and harden cutting-edge AI systems — fully remote and flexible....
Turn your social media instincts and people skills into real impact: grow and energize a thriving online community. Fully remote and flexible....
Turn your ear for audio into AI training gold — transcribe and refine English audio from anywhere. Flexible, remote, start quickly....
Put your investment expertise to work shaping the future of AI. Evaluate portfolio strategies and risk frameworks — remote, flexible, and well-paid....
Put your finance expertise to work shaping the future of AI. Fully remote, flexible contract — up to $95/hr....
Design AI agent training tasks that test end-to-end support triage, from ticket to fix-or-escalate decision. ...
Design AI agent training tasks that test accounting reconciliation with numerically verifiable answers....
Design AI agent training tasks that test data-grounded marketing work: announcements, competitive comparisons, and campaign attribution.You said: ...
Build the systems that power AI — write clean, scalable back end code from anywhere. Remote, flexible, and cutting-edge work....
Train the robots of tomorrow. Bring your ML and MuJoCo expertise to cutting-edge AI simulation projects — fully remote and flexible....
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Get paid to shape how AI writes Lua code. Put your Roblox and scripting expertise to work on cutting-edge AI projects — fully remote and flexible....
Build the systems that measure AI intelligence. Senior engineers — shape how we evaluate cutting-edge AI, fully remote and flexible....
Design AI agent training tasks that test real engineering work: log debugging, bug tracing, and live code fixes. ...
Use your finance expertise and Python skills to teach AI how real analysts think. Fully remote, flexible, and meaningful....
Design AI agent training tasks that test multi-system revenue reconciliation across CRM, orders, and email....
Seeking generalist Math Reasoning Experts to create and refine high‑quality questions in causal inference and experimental design, ensuring rigor and ...
Put your PhD in mathematics to work shaping frontier AI. Remote, flexible, and highly paid — your expertise has never mattered more....
Seeking generalist Physics Reasoning Experts to create and refine high-quality questions across fundamental and applied physics topics, ensuring rigor...
Put your physics PhD to work shaping the future of AI. Help frontier models think like a scientist — fully remote, flexible, and well paid....
Seeking generalist Biology Reasoning Experts to create and refine high-quality questions across a broad range of biological topics, ensuring rigor and...
Seeking PhD-level Biologists to develop, review, and refine advanced questions across specialized areas of biology, ensuring the highest standards of ...
AI labs need domain experts to write, review and grade the material their models learn from. A radiologist checks a diagnostic explanation, a tax accountant writes the reasoning behind a filing, a backend engineer builds a test environment an agent has to solve. That work is bought through a handful of specialist marketplaces, it is almost always remote, and it is almost always paid by the hour or by the task.
The problem is that the work is scattered. Each marketplace runs its own board, its own titles and its own pay conventions, so finding the roles that fit you means checking six sites and mentally converting between them. This page collects the listings into one feed with one set of filters, refreshed daily, and links each one straight through to the marketplace that posted it.
Search by skill, filter by pay, commitment or experience level, and see every marketplace side by side instead of one board at a time.
Every listing links to the original posting. You apply, onboard and get paid by them directly. Skillora does not sit between you and your earnings.
Most of these marketplaces screen with a recorded or live interview. Run the same interview with Skillora first and get feedback on your answers.
Write and review code, build agent environments, grade model output.
Evaluation design, dataset curation and reinforcement-learning work.
Clinical reasoning, diagnostic review and medical exam authoring.
Contract analysis, case reasoning and jurisdiction-specific review.
Modelling, valuation walkthroughs and accounting treatment review.
Translation, transcription, speech recording and native-fluency review.
Physics, chemistry and biology problem authoring and verification.
Consulting cases, operations workflows and process documentation.
Every listing links back to the marketplace that published it. You apply, onboard and get paid by them directly.
Expert contract work across medicine, law, finance and engineering, mostly hourly and often at the top of the rate range.
See Mercor listings
AI-vetted talent network placing engineers and domain specialists on model-training projects.
See micro1 listingsLarge catalogue of AI training roles, heavily weighted towards software engineering and language work.
See Alignerr listingsDomain verticals with published rates, covering coding, maths, writing and specialist subjects.
See Outlier listings
Task-based annotation and model-response review, with an accessible entry path for new contributors.
See DataAnnotation listingsPaid expert studies and evaluation projects, priced per approved study rather than hourly.
See Terac listingsIt is paid work producing or evaluating the data that AI models learn from. In practice that means writing expert answers in your own field, grading model output against a rubric, building coding or tool environments for an agent to solve, recording speech, or reviewing another contributor’s work. It is contract or task-based rather than salaried, and the marketplaces that buy it recruit for specific domains rather than for general labelling.
Rates vary far more than in a normal job market because they track scarcity of expertise, not seniority. General contributor work sits in the $15 to $30 per hour range. Specialist domains such as medicine, law, quantitative finance and senior software engineering routinely post between $60 and $150 per hour, and some expert roles go higher. Some work is priced per task instead of hourly, in which case we show the task fee as published rather than inventing an hourly equivalent.
Usually not. These roles hire for depth in a subject, not for ML skills, because the whole point is to get expertise into the model that the model does not already have. A practising lawyer or a cardiologist is a stronger candidate for a domain role than a generalist who knows how transformers work. Software engineering roles are the exception, since the work itself is writing and reviewing code.
Almost always. The overwhelming majority of listings in this feed are fully remote and asynchronous, which is why they suit contractors, people between roles and anyone doing this alongside another job. Where a listing states a country restriction we show it on the card, and where it states none we say so plainly rather than claiming it is open worldwide.
Mercor, micro1, Alignerr, Outlier, DataAnnotation and Terac. These are the platforms that publish expert AI-training work openly. We refresh the feed once a day and keep listings that have closed accessible, marked as no longer listed, so a link you saved never dies silently.
No. Browsing and applying are free, and you are never asked for an account to see a listing. Where a marketplace runs a referral programme, Skillora may earn a fee if you sign up and work through our link. It costs you nothing, we say so on every listing where it applies, and it has no effect on how listings are ranked. The ranking code has no knowledge of which sources pay.
Every marketplace screens before assigning work, most of them with an interview that is recorded or run by an AI interviewer, followed by a paid trial task. The screen is the part most candidates underestimate: it is where you have to explain your reasoning out loud in your own domain. Practising that specific format is the single highest-leverage thing you can do before applying.
The screen is usually a recorded or live interview in your own domain, followed by a paid trial task. Run that interview with Skillora before you take the real one and get feedback on how you explained your reasoning, not just on what you said.
Practise the screen free