Top 54 Video evaluator Jobs in Remote

Video Evaluator (AI Content)
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
Video Understanding AI Evaluator
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
Video Summarization Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
Autonomous Driving Video Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
DARI TESTING EVALUATOR
ALTA Language Services, Inc. —Remote
- Part-time
- Remote
- Microsoft Excel
- Microsoft Outlook
- Computer literacy
- Paid training
- Health insurance
Quick Apply
Spatial Reasoning Image Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
LITHUANIAN TESTING EVALUATOR
ALTA Language Services, Inc. —Remote
- Part-time
- Remote
- Microsoft Excel
- Microsoft Outlook
- Computer literacy
- Paid training
- Health insurance
Quick Apply
Image Segmentation Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
AI Evaluator - Flexible Hours
Innodata Inc. —Wichita, KS
- $15 an hour
- Full-time
- Remote
- English
- Mid-level
- Master's degree
- Flexible schedule
Quick Apply
Visual Grounding Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
Temporal Action Evaluator
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
AR Scene Evaluator
AuraOne Human Data —Remote
- Remote
- Mid-level
- US work authorization
PORTUGUESE (PORTUGAL) TESTING EVALUATOR
ALTA Language Services, Inc. —Remote
- Part-time
- Remote
- Microsoft Excel
- Microsoft Outlook
- Computer literacy
- Paid training
- Health insurance
Quick Apply
JAMAICAN CREOLE ENGLISH (PATOIS) TESTING EVALUATOR
ALTA Language Services, Inc. —Remote
- Part-time
- Remote
- Microsoft Excel
- Microsoft Outlook
- Computer literacy
- Paid training
- Health insurance
Quick Apply
AI Video Generation Architect
Modern Classrooms Project —Remote
- $170,000 - $200,000 a year
- Choose your own hours
- Remote
- System design
- Math
- Senior level
- Paid parental leave
- Paid holidays
Satellite Imagery Evaluator
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
Retail Shelf Vision Evaluator
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
3D Spatial Evaluator
AuraOne Human Data —Remote
- Part-time
- Remote
- US work authorization
- Senior level
Temporary US Corporate Relations Specialist
The Humane League —Remote
- $63,166 - $77,662 a year
- Temporary
- Google Workspace
- Research
- Mid-level
- Health insurance
- Parental leave
14d
Talent Sourcing Specialist
Sage Haus —Remote
- $35 an hour
- Part-time
- Remote
- Research
- Mid-level
- Communication skills
Quick Apply

I want to receive the latest job alert for video evaluator in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Video Evaluator (AI Content)

AuraOne Human Data
Remote

Apply Now

Job Details

Qualifications

Writing skills

Full Job Description

Video Evaluator (AI Content) is a remote evaluation track for reviewing video evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn video evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

Evaluate video evaluation model outputs against a versioned rubric and assign severity tags for Video Evaluator (AI Content) assignments.
Compare paired responses and pick the stronger answer with a written rationale.
Label hallucinations, instruction-following failures, and unsafe content with structured tags.
Capture ambiguous prompts and route them back to the program team for rubric updates.
Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

Prior evaluation, annotation, or human-rater experience on video evaluation or adjacent content for Video Evaluator (AI Content) work.
Comfort applying multi-page rubrics consistently across long batches.
Clear written reasoning that names the issue and the rubric clause being applied.
Strong attention to detail and the ability to flag when a prompt itself is the problem.
Reliable async availability for at least 10 hours per week.

Example tasks

Compare two video evaluation model responses to the same prompt and pick the stronger one with rationale.
Tag an unsafe response with the correct policy category and severity.
Audit a 50-row batch for rubric consistency and report drift to the program lead.
Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

Background in linguistics, content moderation, or trust & safety review.
Experience with inter-rater agreement metrics and calibration cycles.
Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Video evaluation
Design
AI model evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Apply Now

Refine Your Search

video evaluator jobs in remote

Video Evaluator (AI Content)

Video Understanding AI Evaluator

Video Summarization Evaluator

Autonomous Driving Video Evaluator

DARI TESTING EVALUATOR

Spatial Reasoning Image Evaluator

LITHUANIAN TESTING EVALUATOR

Image Segmentation Evaluator

AI Evaluator - Flexible Hours

Visual Grounding Evaluator

Temporal Action Evaluator

AR Scene Evaluator

PORTUGUESE (PORTUGAL) TESTING EVALUATOR

JAMAICAN CREOLE ENGLISH (PATOIS) TESTING EVALUATOR

AI Video Generation Architect

Satellite Imagery Evaluator

Retail Shelf Vision Evaluator

3D Spatial Evaluator

Temporary US Corporate Relations Specialist

Talent Sourcing Specialist

I want to receive the latest job alert for video evaluator in remote

Related Searches

Explore jobs in more locations

Why this role matters

Responsibilities

Qualifications

Example tasks

Nice to have

Skills

Work model

Compensation

Application process

Job Seeker Tools

Employer Tools

Browse

Stay Connected