Senior Software Engineer - Pairwise Evaluation
Build the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
AI labs pay software engineers to produce the material their coding models learn from. Software engineering AI training jobs are contract work: you write reference solutions, review model-generated code against a rubric, build environments an agent has to solve, and rank competing outputs. Almost all of it is remote, and most of it pays by the hour.
This page collects every live software engineering listing from Mercor, Outlier, DataAnnotation, Alignerr, micro1 and Terac into one feed, refreshed daily. Rates are shown as each marketplace publishes them.
150 open software engineering listings live right now.
Filtering by rate hides per-task listings, which have no hourly equivalent.
Build the AI infrastructure millions rely on — senior-level engineering, fully remote, and genuinely impactful work....
Build the systems that power AI — write clean, scalable back end code from anywhere. Remote, flexible, and cutting-edge work....
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Design, build, test, deploy, and maintain AI software. Develop backend, frontend, APIs, databases, and cloud systems. Debug, optimize, review code, an...
Get paid to shape how AI writes Lua code. Put your Roblox and scripting expertise to work on cutting-edge AI projects — fully remote and flexible....
Design AI agent training tasks that test real engineering work: log debugging, bug tracing, and live code fixes. ...
Seeking generalist JavaScript Coding Experts to create, review, and refine high-quality coding problems and solutions, ensuring rigor and accuracy in ...
Get paid up to $120/hr to put your C++ expertise to work shaping the next generation of AI. Fully remote and flexible....
Get paid to shape AI with your Go expertise. Review and write real-world Golang code — fully remote, flexible hours, competitive pay....
Get paid to challenge AI with expert-level Rust. Shape the future of systems programming — fully remote, flexible hours....
Seeking generalist Java Coding Experts to create, review, and refine high-quality coding problems and solutions, ensuring rigor and accuracy in evalua...
Create and review backend code tasks, assess AI-generated solutions, and ensure accuracy, scalability, and best practices....
Seeking expert SQL developers to create, review, and refine high-quality database query problems and solutions, ensuring rigor and accuracy in evaluat...
Get paid top rates to stress-test AI on real infrastructure challenges — Terraform, Kubernetes, cloud pipelines. Fully remote, async, and high impact....
Get paid $50–$75/hr to build the infrastructure powering next-gen AI — Go, Rust, Python, or C++. Fully remote, high-impact, senior-level contract work...
Get paid to build AI infrastructure that matters — senior Rust engineers wanted for high-impact, fully remote contract work with leading AI labs....
Build the AI infrastructure of tomorrow — get paid top dollar to write production Rust for leading AI labs. Remote, flexible, high-impact....
Put your Rust expertise to work on real AI infrastructure. Remote contract, serious pay, and systems that matter at scale....
Get paid to build real AI infrastructure in Rust — high-performance pipelines, annotation tooling, and eval systems for leading AI labs. Fully remote....
Get paid top rates to build the infrastructure powering next-gen AI — elite Rust engineers wanted for high-impact, fully remote contract work....
Put your Rust expertise to work on real AI infrastructure. Remote contract, flexible hours, and serious impact at the frontier of AI....
Get paid top rates to build the AI infrastructure that powers next-gen models — Rust expertise wanted. Fully remote, high-impact contract work....
Build the infrastructure powering next-gen AI — $50–$75/hr to architect real production systems for leading AI labs. Remote & flexible....
Get paid $50–$75/hr to build AI infrastructure that shapes the future of machine learning. Senior Python engineers wanted — fully remote, high impact....
The work splits into three tiers. At the base: grading model answers to coding prompts and fixing what the model got wrong. In the middle: writing hard problems with test suites, and reviewing pull requests the model produced. At the top: building reinforcement-learning environments, realistic codebases with tasks an agent has to complete, which is the closest this market gets to normal senior engineering work.
Seniority is the pricing axis. The marketplaces bid hardest for engineers who can judge production code, not just write it. A staff-level engineer reviewing agent trajectories earns a multiple of what a bootcamp graduate earns rating snippets, and the listings say so in the rate.
Six marketplaces publish this work openly. Every listing above links to the one that posted it, and each has its own page here covering pay, screening and who gets hired.
Four things, mostly. Write reference solutions to programming problems, with tests. Grade and correct model-generated code against a rubric. Review agent transcripts and mark where the reasoning went wrong. Build coding environments, small repos with a task and a verifier, that labs use to train agents. The mix varies by marketplace: DataAnnotation leans toward grading tasks, Mercor and micro1 toward project work.
Published rates in this feed run from roughly $25 an hour for entry coding tasks to $150 and above for senior and staff-level project work. The middle of the market sits between $40 and $70. Rates track how hard you are to replace: anyone can rate a snippet, few people can review a distributed-systems design, and the listings price accordingly. Check the cards above for what is live right now.
No. The labs have ML researchers; what they are buying from you is engineering judgment their models do not have yet. Strong fundamentals, code review instincts and clear written English matter more than knowing how transformers work. The one exception is RL environment work, where familiarity with agent tooling and evaluation harnesses gets you into the best-paid projects.
Usually, yes. Most listings are part-time contracts with asynchronous hours, which is why the market skews toward working engineers moonlighting. Two things to check first: your employment agreement, since some employers restrict paid outside work, and the marketplace NDA, which will bar you from using anything you see in training data elsewhere.
A coding assessment, an AI-run technical interview, or both. Mercor and micro1 interview you with an AI that probes your reasoning while you solve problems; Outlier and DataAnnotation gate access with unpaid assessments. The interview format trips up strong engineers who code silently: it scores how you explain decisions, not just whether the code runs. Practising that format before the real screen is the highest-leverage preparation.
Every marketplace above screens with an interview or assessment in your own domain before assigning paid work. Run that interview with Skillora first and get feedback on how you explained your reasoning, not just on what you said.
Practise the screen free