Expert Talent Pool, Feedback and Alignment (Senior Expert)
Cleraremote
Applied? Get the next “Expert Talent Pool” jobs by email
One email a day with new "Expert Talent Pool" roles. Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link.
⚑ Flagged: ghost-job signals. Risk level: medium. How we flag ghost jobs →
Developer
About the Role
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.
What You'll Do
Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
Fact-check complex claims against primary sources and verify accuracy.
Assess answers against content policies, style guides, and edge cases.
Review other raters' work, calibrate standards, and develop or refine grading guidelines.
Assess search relevance and provide feedback in live sessions.
What We're Looking For
At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
Native or near-native written English proficiency.
Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
An advanced degree, professional license, or deep working expertise in the domain you grade.
Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.
Compensation & Benefits
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.
Location
Fully remote. Projects typically run from one week to several months.
Apply for this role Opens jobs.ashbyhq.com — verified as the employer's own application page
Keep looking
Similar remote roles, still open
- 15h ago
- 15h ago
- 1d ago
Expert Talent Pool, Data Operations (Expert, 5+ Years)
Cleraremote$93.6K – $187.2K
- 1d ago
Expert Talent Pool, Annotation Associate
Cleraremote$15 - $35/hr
See every "Expert Talent Pool" role →
Get new “Expert Talent Pool” roles by email
One email a day with what is new in "Expert Talent Pool". Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link.
Or follow the daily Telegram channel for the best new remote roles every morning.
Your turn · no account needed
Help the next applicant
You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.
I know what it pays
Sign in with Google to earn points for reports.
Where this listing came from
- 17 Nov 2026Ats Boards first sighting
Seen on 1 board over 0 days.