Software Developer — Evaluate an AI Coding Assistant

Software Developer — Evaluate an AI Coding Assistant

Alignerr · Paid contract · Fully remote · Flexible schedule

About the Role

Alignerr is looking for software developers to work with an AI coding assistant on real tasks in existing codebases. You’ll bring a task you know how to evaluate, work through it with the assistant, and share your perspective on what helped you make progress and where you had to step in.

What You’ll Do

• Choose a meaningful task in an eligible open-source project, such as fixing a recurring bug, adding a feature, or simplifying code that’s hard to maintain.
• Work through the task with the assistant. Review its changes, test the result, and follow up as you would in your usual development work.
• Give feedback in your own words. When the assistant offers different approaches, explain which one you’d prefer and why.

Who You Are

• You have hands-on experience developing and testing software in an existing codebase.
• You can define what a successful change should do and verify that it works.
• You can explain your technical judgment clearly, including when an assistant misunderstood a request or made your work easier.
• You’re comfortable working independently on tasks that take several hours.

Project Eligibility

You can work on your own open-source project or another public codebase with an eligible license. Choose code you have permission to share, and keep confidential material, credentials, and personal data out of your submissions. Your submitted work and feedback may be used to improve AI coding tools.