About the role
From AfterQuery’s listing.
Pay: $63/hour
IT support specialists to build the troubleshooting scenarios frontier AI labs use to test model judgment.
AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring IT support specialists as contractors to author and grade the troubleshooting scenarios those evaluations run on.
What you'll actually do
- Author realistic IT support scenarios, from first contact through diagnosis and resolution
- Write reference answers with the diagnostic reasoning behind each step
- Grade model output for technical accuracy and user safety
- Flag advice that reads plausible but would make the problem worse
Who this is for
- Specialists with at least 2 years in IT support, help desk, or system administration
- Practitioners with hands on experience in enterprise environments such as Active Directory, Microsoft 365, or MDM tools
- Troubleshooters with depth across hardware, software, and networking issues
- Clear writers who can document the reasoning behind a diagnostic decision
Contract and pay
- $45 to $80/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.
- Fully remote, fully async. No fixed hours.
- Minimum 10 hours per week, no maximum. Scale up or down week to week.
- No screen recording, no keystroke monitoring, no idle timers.
- Independent contractor. Ongoing project work rather than single task batches.
Who can apply
The listing only says “Remote”. That doesn’t mean worldwide. Check country eligibility on AfterQuery before you spend time on it.
How AfterQuery screens people
- 01Apply to the listing for your field.
- 02Expect a screening task that looks like the real work.
Before you apply
- No real platform charges you to apply or to “unlock” work.
- Apply to two or three platforms, not one. Acceptance is never certain.
- It’s contract work in projects. Hours vary week to week.
More generalist jobs
Domain Contributor - Evaluation Specialist
Location not statedGeneralistBeginner-friendly
$30–60/hr
for hours worked
Evaluation Specialist/Recent Grad
Location not statedGeneralistBeginner-friendly
$20–60/hr
for hours worked
Market Research Expert
17 countries incl. United States, IndiaGeneralist
Up to $65/hr
for hours worked
PR & Communications Expert
17 countries incl. United States, IndiaGeneralist
Up to $70/hr
for hours worked