Top 2500 Ai content evaluation specialist Jobs in Remote Work From Home

AI Content Evaluation Specialist
AuraOne Human Data —Remote
- Part-time
- Remote
- Bilingual
- Writing skills
- Mid-level
12h
AI Evaluation Specialist
AuraOne Human Data —Remote
- Part-time
- Remote
- Bilingual
- Writing skills
- Mid-level
12h
AI Evaluation Specialist
Handshake AI —Remote
- $17 an hour
- Part-time
- Remote
- Research
- US work authorization
- Entry level
AI Specialist
Infoorigin inc —Remote
- $21.91 - $25.30 an hour
- Contract
- Remote
- Research
- SQL
- Senior level
Quick Apply
6d
Religion Specialist – Freelance AI Trainer Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- Teaching
- Entry level
- Health insurance
AI Workflow Specialist
AuraOne Human Data —Remote
- Part-time
- Remote
- Bilingual
- Writing skills
- Mid-level
12h
Wellness & Nutrition Content Expert, AI Review, Part-Time
mpathic —Seattle, WA
- $30 - $40 an hour
- Part-time
- Remote
- Psychiatry
- Mid-level
- Communication skills
Quick Apply
Literature Specialist – Freelance AI Trainer Project
Meridial —Austin, TX
- $6 - $65 an hour
- Remote
- Analysis skills
- Teaching
- Entry level
- Health insurance
Training and Development Specialist - Freelance AI Trainer Project
Meridial —Austin, TX
- $8 - $65 an hour
- Remote
- Mid-level
- Education
Generalist AI Evaluation Specialist
AuraOne Human Data —Remote
- $35 - $40 an hour
- Remote
- Mid-level
- US work authorization
12h
Psychology Specialist - Freelance AI Trainer Project
Meridial —Remote
- $8 - $65 an hour
- Remote
- Mid-level
- Bachelor's degree
- Psychology
- Health insurance
Epidemiology Specialist - Freelance AI Trainer Project
Meridial —Austin, TX
- $8 - $65 an hour
- Remote
- Doctor of Philosophy
- Senior level
- Health insurance
Student Safety Specialist (Content Reviewer) — Part-Time / On-Call
Lightspeed Systems —Remote
- Part-time
- Writing skills
- Physical & Rehabilitation Medicine
- High school diploma or GED
Search Engine Evaluation Specialist - Freelance AI Trainer Project
Meridial —Austin, TX
- $20 an hour
- Remote
- Writing skills
- Mid-level
- Quality control
- Health insurance
Journalism Evaluation Specialist
AuraOne Human Data —Remote
- Part-time
- Remote
- Bilingual
- Mid-level
- US work authorization
12h
Factuality Evaluation Model Evaluation Specialist
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
12h
English Voice Coaching Evaluation Specialist
AuraOne Human Data —Remote
- Remote
- Writing skills
- Mid-level
- US work authorization
12h
Cantonese Audio Evaluation Specialist
AuraOne Human Data —Remote
- $50 an hour
- Remote
- Writing skills
- Mid-level
- US work authorization
12h
Entry-Level Image Evaluation Specialist
AuraOne Human Data —Remote
- $50 an hour
- Remote
- US work authorization
- Entry level
12h
Multi-Turn Conversation Model Evaluation Specialist
AuraOne Human Data —Remote
- Part-time
- Remote
- Writing skills
- Mid-level
- US work authorization
12h

I want to receive the latest job alert for ai content evaluation specialist in remote work from home

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

ai content evaluation specialist jobs near remote work from home

AI Content Evaluation Specialist

AuraOne Human Data
Remote

Apply Now

Job Details

Part-time
12 hours ago

Qualifications

Bilingual
Tooling
Writing skills
Rubric-based evaluation
AI tools proficiency
Mid-level
Incident Escalation
Case review audits
Document review
Technical skills instruction
Red flag analysis
Model evaluation
Rubric-based test scoring
Content review
Project stakeholder communication

Full Job Description

AI Content Evaluation Specialist is a remote review track for evaluating AI outputs across ai content evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

Why this role matters

AI Content Evaluation specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.

Responsibilities

Review AI outputs against current ai content evaluation specialist operations workflows, playbooks, and firm policy for AI Content Evaluation Specialist assignments.
Grade tone, escalation logic, and stakeholder fit on a structured rubric.
Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
Capture the right next step so the modeling team can train on it.
Adjudicate disputed treatments against published playbooks or firm guidance.
Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

Direct working experience in ai content evaluation specialist operations on real teams for AI Content Evaluation Specialist work.
Comfort applying multi-page rubrics consistently across long batches.
Clear written reasoning that names the policy or workflow being applied.
Strong attention to detail and the ability to flag when a prompt itself is the problem.
Reliable async availability for at least 10 hours per week.

Example tasks

Grade a model's response to a real ai content evaluation specialist operations ticket and rate workflow, tone, and escalation.
Flag a missed escalation with the right severity tag and corrected next step.
Adjudicate a disputed playbook call between two reviewers using firm guidance.
Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

Prior experience training, calibrating, or QA-ing operations teams.
Familiarity with AI-assisted workflow tooling and its failure modes.
Bilingual experience for cross-region operations.

Skills

Operational review
Policy adherence
Workflow judgment
Stakeholder communication
AI Content Evaluation specialist operations
AI model evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Apply Now

Refine Your Search

ai content evaluation specialist jobs in remote work from home

AI Content Evaluation Specialist

AI Evaluation Specialist

AI Evaluation Specialist

AI Specialist

Religion Specialist – Freelance AI Trainer Project

AI Workflow Specialist

Wellness & Nutrition Content Expert, AI Review, Part-Time

Literature Specialist – Freelance AI Trainer Project

Training and Development Specialist - Freelance AI Trainer Project

Generalist AI Evaluation Specialist

Psychology Specialist - Freelance AI Trainer Project

Epidemiology Specialist - Freelance AI Trainer Project

Student Safety Specialist (Content Reviewer) — Part-Time / On-Call

Search Engine Evaluation Specialist - Freelance AI Trainer Project

Journalism Evaluation Specialist

Factuality Evaluation Model Evaluation Specialist

English Voice Coaching Evaluation Specialist

Cantonese Audio Evaluation Specialist

Entry-Level Image Evaluation Specialist

Multi-Turn Conversation Model Evaluation Specialist

I want to receive the latest job alert for ai content evaluation specialist in remote work from home

Related Searches

Explore jobs in more locations

Why this role matters

Responsibilities

Qualifications

Example tasks

Nice to have

Skills

Work model

Compensation

Application process

Job Seeker Tools

Employer Tools

Browse

Stay Connected