Why this grade
This listing scored 51/100, which is a D. It lost the most ground on pay transparency.
- Remote clarity 15 / 15 Whether "remote" means anywhere, or is quietly restricted to one country.
- Description depth 14 / 20 How much the posting actually says about the work, measured in characters of real text.
- Freshness 12 / 15 How recently it was posted. Older postings are likelier to be filled or abandoned.
- Corroboration 10 / 10 Whether more than one source carries this listing.
- Role specificity 0 / 10 Whether the listing is tagged well enough to tell what the role actually is.
- Pay transparency 0 / 25 A published salary range, worth more than any other single factor because it is what a candidate cannot find out without applying.
Every figure above is arithmetic over the posting itself — its salary field, its text, its age, its tags and how many sources carry it. How the grades work →
Headquarters: California
URL: https://imerit.ai/
iMerit is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
- Interpret conversational context and identify what the user really wanted
- Rate and rank responses against defined quality criteria
- Compare multiple answers and explain in writing why one wins
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably assessed rather than guessing
What you bring:
- Strong critical thinking and sound judgment in ambiguous cases
- Solid research skills and attention to detail
- Excellent reading comprehension
- Self direction and the discipline to hit deadlines without supervision
Good to know
- Independent contractor engagement for the length of the project.
- Fully remote and flexible.
- You choose your hours as long as volume and deadlines are met.
- Task volume varies with project demand.
To apply: https://weworkremotely.com/remote-jobs/imerit-ai-response-evaluator
Apply for this role Opens weworkremotely.com — the link as listed; we have not yet verified it is the employer's own page
Quick question · anonymous · one tap
Would you apply to this job?
Answer to see what other job seekers said.
Keep looking
Similar remote roles, still open
-
D
1h ago
Bridgenext Argentina
- D 7h ago
- D 7h ago
-
B
7h ago
KNOWLEDGE CENTER TIER I AGENT (JUNIOR)
Empower AI Inc. United States $57k - $83k/yr
See every "AI Response Evaluator" role →
Get new “AI Response Evaluator” roles by email
One email a day with what is new in "AI Response Evaluator". Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link. Alerts are ours, not a third party's.
Your turn · no account needed
Help the next applicant
You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.
I know what it pays
Sign in with Google to earn points for reports — 100 confirmed points buy a week of Early Access.
Where this listing came from
- 08 Sep 2026 We Work Remotely first sighting
- 09 Sep 2026 Company careers page employer ATS also listed the same day
Seen on 2 boards over 25 days.