About the role
From Braintrust’s listing.
Pay: $23/hour
Client: Turing
We’re looking for detail-oriented Quality Analysts to evaluate and compare chatbot responses and help improve AI systems.
What you’ll do
- Compare responses for accuracy, relevance, completeness, clarity and adherence to evaluation guidelines.
- Identify subtle errors, inconsistencies and missing information, and provide clear, structured feedback and final assessments.
- Apply review guidelines consistently, document findings and work with quality teams to resolve questions or escalate complex cases.
- Meet project quality, productivity and turnaround expectations.
What you’ll bring
- 3+ years of experience in quality assurance, data annotation, content evaluation, testing or a similar role.
- Strong analytical, critical-thinking and problem-solving skills, with excellent written and verbal communication.
- Attention to detail and the ability to follow detailed evaluation guidelines, work independently and manage multiple tasks.
- Comfort working with AI tools, chatbots and online platforms.
- Experience with chatbot evaluation, LLM testing or data-quality projects is a plus.
Engagement
Fully remote for contributors based in the United States. Expected project duration is 16 weeks, with an immediate start. You must be available for 8 hours per day, five days per week, including weekends as required, with two weekdays off and at least four hours of overlap with Pacific Time. Actual workload is project-dependent.
How Braintrust screens people
- 01Create a Braintrust profile and apply to the job.
- 02Some clients run their own selection on top, for example an AI interview, a domain task and a recruiter interview.
Before you apply
- No real platform charges you to apply or to “unlock” work.
- Apply to two or three platforms, not one. Acceptance is never certain.
- It’s contract work in projects. Hours vary week to week.
More generalist jobs
Pay on listing
Pay on listing
Domain Contributor - Evaluation Specialist
Location not statedGeneralistBeginner-friendly
$30–60/hr
for hours worked
$20–60/hr
for hours worked