Skip to content
GeneralistFreelanceNot in Africa

AI Image and Video Judge: Spot the Flaws, Pick the Winner

On Outlier, run by Scale AI

Up to $15/hr

Compare AI-generated images and videos, hold live spoken conversations with AI voice models, and explain in writing which output is better and why. It suits fluent English speakers with a sharp eye and ear, but none of the countries it accepts are in Africa.

Opens the listing on app.outlier.ai. ASV earns nothing from this link. Disclosure

Pay

Up to $15/hr

In US dollars, for core project work, before Outlier's Missions incentives; the board's card shows a higher top figure. Rates vary with expertise, skills assessment results, location and project needs, and lower rates apply during onboarding.

Type
Freelance
Hours
Flexible hours
Africa
Not in Africa
Platform
Outlier
Posted
Oct 29, 2026

01 · The role

What you would do

  • Talk through realistic scenarios in English with AI voice models, then rank how natural, useful and clear they sounded
  • Compare pairs of AI-generated images and videos and decide which one better follows its prompt
  • Look and listen closely for flaws such as distorted bodies, flickering motion, garbled text or audio out of step with the picture
  • Score each output for prompt adherence, quality and realism, and write a specific explanation of what you noticed

02 · Requirements

What they ask for

  • Fluent spoken and written English, including relaxed everyday conversation
  • A bachelor's degree or higher, completed or under way
  • A computer with reliable internet, headphones and a quiet place to talk
  • Write your own ratings and explanations: AI tools are not allowed for them
  • Pass a short screening, which may include a spoken English check

Helpful, not required

  • Experience writing short reviews or explanations backed by evidence
  • Comfort making a firm call when both options have flaws
  • Image evaluation
  • Video evaluation
  • Voice AI
  • English
  • Attention to detail

03 · Eligibility

Who can apply

Remote, for people living in one of the 33 countries the board lists for it, none of them in Africa, so it is not open to people living in Nigeria, Kenya, Ghana, South Africa or Egypt.

Countries named in the listing: Argentina, Australia, Austria, Belgium, Brazil, Canada, Colombia, Denmark, Finland, France, Germany, India, Indonesia, Ireland, Italy, Japan, Luxembourg, Malaysia, Mexico, Netherlands, New Zealand, Norway, Peru, Philippines, Puerto Rico, Singapore, Spain, Sweden, Switzerland, United Arab Emirates, United Kingdom, United States, Venezuela.

Not in Africa

As far as the listing and Outlier's country rules show, this role is not open to people living in Nigeria, Kenya, Ghana, South Africa or Egypt. Outlier in Africa

Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.

04 · Applying

How to get in

You apply through Outlier's own process. The steps from sign-up to first paid task are on its profile.

05 · Source

About this listing

We last confirmed this opening on Nov 2, 2026, and it was posted on Oct 29, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Outlier's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.

The listing on app.outlier.ai(opens in a new tab)

More open roles like this.

All openings

The platform

Outlier

Scale AI

Scale AI's freelance network for training and evaluating AI models.

$10–$50/hrAssessedGeneralist, Software & code, Math & science, Languages, Domain experts

Outlier

Ready to apply? Read the listing first.

Check the rate, the hours and who can apply against the listing, follow the platform's own steps, and keep a second application going.

AI Image and Video Judge: Spot the Flaws, Pick the Winner

Up to $15/hr

Apply(opens in a new tab)