Senior Software Engineer - Pairwise Evaluation
Build the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
Expert gig work training and evaluating AI models, aggregated from the marketplaces that actually pay for it.
1,347 open listings across 6 marketplaces, refreshed daily.
Filtering by rate hides per-task listings, which have no hourly equivalent.
266 listings
Clear filtersBuild the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
Design AI agent training tasks that test end-to-end support triage, from ticket to fix-or-escalate decision. ...
Build the systems that power AI — write clean, scalable back end code from anywhere. Remote, flexible, and cutting-edge work....
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Get paid to shape how AI writes Lua code. Put your Roblox and scripting expertise to work on cutting-edge AI projects — fully remote and flexible....
Design AI agent training tasks that test real engineering work: log debugging, bug tracing, and live code fixes. ...
Design AI agent training tasks that test multi-system revenue reconciliation across CRM, orders, and email....
Seeking generalist JavaScript Coding Experts to create, review, and refine high-quality coding problems and solutions, ensuring rigor and accuracy in ...
Get paid up to $120/hr to put your C++ expertise to work shaping the next generation of AI. Fully remote and flexible....
Get paid to shape AI with your Go expertise. Review and write real-world Golang code — fully remote, flexible hours, competitive pay....
Get paid to challenge AI with expert-level Rust. Shape the future of systems programming — fully remote, flexible hours....
Seeking generalist Java Coding Experts to create, review, and refine high-quality coding problems and solutions, ensuring rigor and accuracy in evalua...
Create and review backend code tasks, assess AI-generated solutions, and ensure accuracy, scalability, and best practices....
Seeking expert SQL developers to create, review, and refine high-quality database query problems and solutions, ensuring rigor and accuracy in evaluat...
Get paid top rates to stress-test AI on real infrastructure challenges — Terraform, Kubernetes, cloud pipelines. Fully remote, async, and high impact....
Get paid $50–$75/hr to build the infrastructure powering next-gen AI — Go, Rust, Python, or C++. Fully remote, high-impact, senior-level contract work...
Get paid to build AI infrastructure that matters — senior Rust engineers wanted for high-impact, fully remote contract work with leading AI labs....
Build the AI infrastructure of tomorrow — get paid top dollar to write production Rust for leading AI labs. Remote, flexible, high-impact....
Put your Rust expertise to work on real AI infrastructure. Remote contract, serious pay, and systems that matter at scale....
Get paid to build real AI infrastructure in Rust — high-performance pipelines, annotation tooling, and eval systems for leading AI labs. Fully remote....
Get paid top rates to build the infrastructure powering next-gen AI — elite Rust engineers wanted for high-impact, fully remote contract work....
Put your Rust expertise to work on real AI infrastructure. Remote contract, flexible hours, and serious impact at the frontier of AI....
Get paid top rates to build the AI infrastructure that powers next-gen models — Rust expertise wanted. Fully remote, high-impact contract work....
AI labs need domain experts to write, review and grade the material their models learn from. A radiologist checks a diagnostic explanation, a tax accountant writes the reasoning behind a filing, a backend engineer builds a test environment an agent has to solve. That work is bought through a handful of specialist marketplaces, it is almost always remote, and it is almost always paid by the hour or by the task.
The problem is that the work is scattered. Each marketplace runs its own board, its own titles and its own pay conventions, so finding the roles that fit you means checking six sites and mentally converting between them. This page collects the listings into one feed with one set of filters, refreshed daily, and links each one straight through to the marketplace that posted it.
Search by skill, filter by pay, commitment or experience level, and see every marketplace side by side instead of one board at a time.
Every listing links to the original posting. You apply, onboard and get paid by them directly. Skillora does not sit between you and your earnings.
Most of these marketplaces screen with a recorded or live interview. Run the same interview with Skillora first and get feedback on your answers.
Write and review code, build agent environments, grade model output.
Evaluation design, dataset curation and reinforcement-learning work.
Clinical reasoning, diagnostic review and medical exam authoring.
Contract analysis, case reasoning and jurisdiction-specific review.
Modelling, valuation walkthroughs and accounting treatment review.
Translation, transcription, speech recording and native-fluency review.
Physics, chemistry and biology problem authoring and verification.
Consulting cases, operations workflows and process documentation.
Every listing links back to the marketplace that published it. You apply, onboard and get paid by them directly.
Expert contract work across medicine, law, finance and engineering, mostly hourly and often at the top of the rate range.
See Mercor listings
AI-vetted talent network placing engineers and domain specialists on model-training projects.
See micro1 listingsLarge catalogue of AI training roles, heavily weighted towards software engineering and language work.
See Alignerr listingsDomain verticals with published rates, covering coding, maths, writing and specialist subjects.
See Outlier listings
Task-based annotation and model-response review, with an accessible entry path for new contributors.
See DataAnnotation listingsPaid expert studies and evaluation projects, priced per approved study rather than hourly.
See Terac listingsIt is paid work producing or evaluating the data that AI models learn from. In practice that means writing expert answers in your own field, grading model output against a rubric, building coding or tool environments for an agent to solve, recording speech, or reviewing another contributor’s work. It is contract or task-based rather than salaried, and the marketplaces that buy it recruit for specific domains rather than for general labelling.
Rates vary far more than in a normal job market because they track scarcity of expertise, not seniority. General contributor work sits in the $15 to $30 per hour range. Specialist domains such as medicine, law, quantitative finance and senior software engineering routinely post between $60 and $150 per hour, and some expert roles go higher. Some work is priced per task instead of hourly, in which case we show the task fee as published rather than inventing an hourly equivalent.
Usually not. These roles hire for depth in a subject, not for ML skills, because the whole point is to get expertise into the model that the model does not already have. A practising lawyer or a cardiologist is a stronger candidate for a domain role than a generalist who knows how transformers work. Software engineering roles are the exception, since the work itself is writing and reviewing code.
Almost always. The overwhelming majority of listings in this feed are fully remote and asynchronous, which is why they suit contractors, people between roles and anyone doing this alongside another job. Where a listing states a country restriction we show it on the card, and where it states none we say so plainly rather than claiming it is open worldwide.
Mercor, micro1, Alignerr, Outlier, DataAnnotation and Terac. These are the platforms that publish expert AI-training work openly. We refresh the feed once a day and keep listings that have closed accessible, marked as no longer listed, so a link you saved never dies silently.
No. Browsing and applying are free, and you are never asked for an account to see a listing. Where a marketplace runs a referral programme, Skillora may earn a fee if you sign up and work through our link. It costs you nothing, we say so on every listing where it applies, and it has no effect on how listings are ranked. The ranking code has no knowledge of which sources pay.
Every marketplace screens before assigning work, most of them with an interview that is recorded or run by an AI interviewer, followed by a paid trial task. The screen is the part most candidates underestimate: it is where you have to explain your reasoning out loud in your own domain. Practising that specific format is the single highest-leverage thing you can do before applying.
The screen is usually a recorded or live interview in your own domain, followed by a paid trial task. Run that interview with Skillora before you take the real one and get feedback on how you explained your reasoning, not just on what you said.
Practise the screen free