Top 1472 Content evaluation Jobs in Remote

Customer Support Specialists, AI Response Evaluation
mpathic —Seattle, WA
- $30 - $40 an hour
- Part-time
- Remote
- Mid-level
- Analysis skills
- Communication skills
Quick Apply
Sports Specialist - Freelance AI Trainer Project
Meridial —Remote
- $8 - $65 an hour
- Remote
- Mid-level
- Analysis skills
- Communication skills
- Health insurance
Wellness & Nutrition Content Expert, AI Review, Part-Time
mpathic —Seattle, WA
- $30 - $40 an hour
- Part-time
- Remote
- Psychiatry
- Mid-level
- Communication skills
Quick Apply
Music Content Analyst - AI Trainer
Handshake AI —Remote
- Part-time
- Remote
- Mid-level
- Bachelor's degree
Social Media Annotation - Freelance AI Trainer Project
Meridial —Remote
- $16 - $28 an hour
- Remote
- Analysis skills
- No degree
- Entry level
TESOL Technical Officer II, OPEN Content Development and Monitoring & Evaluation
FHI 360 —Remote
- $68,000 - $88,000 a year
- Full-time
- English
- Master's degree
- Analysis skills
- Paid holidays
- Paid time off
2d
Content Creator (Flexible Gig)
HumanSignal —Remote
- Up to $80 an hour
- Contract
- No experience needed
- Smartphone
- Entry level
- Flexible schedule
Search Engine Evaluation Specialist - Freelance AI Trainer Project
Meridial —Remote
- $20 an hour
- Remote
- Writing skills
- Mid-level
- Quality control
- Health insurance
Part-Time Faculty: SWK 601 (M700) - Fundamentals of Social Work Practice I (Fall 2026)
Syracuse University —Remote
- $2,084.07 - $2,146.59 an hour
- Part-time
- Master of Social Work
- Mid-level
- University
Viral Content Editor
Mad Maxy LLC —Remote
- From $700 a week
- Contract
- Remote
- English
- Mid-level
- Time management
- Flexible schedule
Quick Apply
8d
Content Editor / Writer with Machine Learning Experience
AUQ —Remote
- Contract
- Mid-level
- AI
- Flexible schedule
Associate, Scoring Service
Pearson —Remote
- From $17.50 an hour
- Part-time
- Remote
- School experience
- Computer literacy
- Teaching Certification
- Disability insurance
Part-Time Faculty: SWK 740 (M701) Treatment of Complex Trauma with Individuals (Fall 2026)
Syracuse University —Remote
- $2,084.07 - $2,146.59 a month
- Part-time
- Master of Social Work
- Adults
- Mid-level
Marketing Coordinator
Geisinger —Remote
- Full-time
- Remote
- 5 years
- Computer literacy
- Mid-level
- Health insurance
- Dental insurance
Information Specialist - Freelance AI Trainer Project
Meridial —Remote
- $10 - $30 an hour
- Remote
- Writing skills
- Mid-level
- Quality control
- Health insurance
Umbundu Language Specialist - Freelance AI Trainer Project
Meridial —Remote
- $8 - $65 an hour
- Remote
- Mid-level
- Communication skills
Director of Training Content & Curriculum
Upwardly Global —Remote
- $67,000 a year
- Full-time
- Remote
- 7 years
- Continuous improvement
- Mentoring
Mongolian Language Specialist - Freelance AI Trainer Project
Meridial —Remote
- $8 - $65 an hour
- Remote
- Mid-level
- Communication skills
- Teaching
Social Media Coordinator
ScreenRant —Remote
- Remote
- Computer skills
- Entry level
- Analytics
- Flexible schedule
Quick Apply
Email Marketing Specialist - Remote Job
EnthuZiastic —Remote
- Extended hours
- Remote
- Entry level

I want to receive the latest job alert for content evaluation in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Customer Support Specialists, AI Response Evaluation

mpathic -
Seattle, WA

Quick Apply

Job Details

Part-time
$30 - $40 an hour

Qualifications

Performance dashboards
Confidential information handling
Email customer support
Technical support via phone
Texting/chatbox tools
Phone communication
Spreadsheets
Triage
Coaching
Customer satisfaction tracking
AI tools proficiency
Slack
Gap analysis
De-escalation techniques
Conflict de-escalation
Mid-level
Incident Escalation
Quality assurance experience within IT
Analysis skills
Decision making
Team training
Call monitoring
Customer support
Quality control communication
Red flag analysis
Technical support via email
SaaS
Escalation handling
Model evaluation
Content review

Full Job Description

About mpathic.ai

Keeping the human in AI. mpathic is a trusted leader in advancing quality and safety in AI systems through expert-led evaluation and human data. We partner with leading technology companies to support red teaming, trust & safety, expert annotation, and model evaluation across high-stakes domains.

Our reviewers bring deep expertise in behavioral analysis, conversational design, mental health, and increasingly, financial and enterprise decision-making contexts.

About the Role

mpathic is seeking part-time Customer Support Specialists to support a red-teaming and quality assurance (QA) campaign focused on evaluating AI system behavior in customer-facing interactions.

In this role, you will review AI-generated responses and multi-turn conversations to assess quality, accuracy, tone, and safety—similar to evaluating customer support agents. You will identify issues such as incorrect information, poor customer experience, inappropriate tone, or failure to resolve user needs effectively.

This is not a traditional support role. Instead, it focuses on evaluating AI performance, applying your customer support expertise to assess how well AI systems handle real-world customer interactions.

What You’ll Be Working On

You will help identify, prevent, and characterize risks that emerge when users interact with AI-powered support systems.

Responsibilities may include:

Reviewing AI-generated customer support responses for accuracy, clarity, and helpfulness
Evaluating tone, empathy, and professionalism in customer interactions
Identifying poor support behaviors (e.g., dismissiveness, lack of resolution, incorrect guidance)
Assessing whether AI responses appropriately address customer intent and resolve issues
Evaluating how AI handles frustration, confusion, or escalating user behavior
Identifying gaps in responses, including missing steps, unclear instructions, or lack of follow-through
Detecting overconfident, misleading, or incorrect responses
Evaluating multi-turn conversations for consistency, escalation handling, and resolution quality
Identifying patterns of agreement without problem-solving (e.g., empty empathy or unhelpful reassurance)
Participating in or reviewing red teaming exercises to surface failure modes in support scenarios
Supporting quality assurance (QA) to ensure consistency across evaluations
Documenting edge cases, failure patterns, and customer experience risks
Providing structured written feedback to internal teams
Collaborating with interdisciplinary teams on AI quality, safety, and evaluation frameworks
Maintaining strict confidentiality and quality standards

This role requires strong judgment, attention to detail, and the ability to evaluate nuanced customer interactions.

What We’re Looking For

Successful candidates are detail-oriented, customer-focused, and experienced in evaluating or delivering high-quality support in fast-paced environments.

Professional experience in one or more of the following:

Customer support (chat, email, or phone)
Call centers or contact centers
Technical support or help desk roles
Online support environments (SaaS, e-commerce, fintech, etc.)

Strong understanding of:

High-quality customer experience and service standards
Effective communication in customer-facing interactions
Common support workflows (triaging, troubleshooting, escalation)
How customers interpret and respond to support interactions

Ability to identify:

Poor or incomplete resolutions
Incorrect or misleading information
Inappropriate tone (e.g., robotic, dismissive, overly casual)
Lack of empathy or ineffective de-escalation
Failure to follow support best practices

Strong written communication skills and ability to clearly explain reasoning

Experience with or interest in:

Evaluating conversations or QA for support teams
Working with AI tools, chatbots, or automated systems
Assessing how systems perform under real customer behavior

Comfort with:

Tech tools and platforms (Slack, spreadsheets, dashboards)
Evaluating AI-generated responses (no coding required, but must be tech-comfortable)
Ambiguity, iteration, and feedback-driven workflows

Willingness to:

Sign NDAs and work with sensitive content

Nice to Have (Not Required)

Experience in QA, coaching, or training within support teams
Background in trust & safety or content moderation
Experience with chatbot or AI-assisted support tools
Familiarity with CX metrics (CSAT, QA scoring, resolution rate)
Interest in AI, automation, or improving customer experience systems

Compensation

$30-40/hour, depending on experience and specific project tasks/difficulty

Quick Apply

Refine Your Search

content evaluation jobs in remote

Customer Support Specialists, AI Response Evaluation

Sports Specialist - Freelance AI Trainer Project

Wellness & Nutrition Content Expert, AI Review, Part-Time

Music Content Analyst - AI Trainer

Social Media Annotation - Freelance AI Trainer Project

TESOL Technical Officer II, OPEN Content Development and Monitoring & Evaluation

Content Creator (Flexible Gig)

Search Engine Evaluation Specialist - Freelance AI Trainer Project

Part-Time Faculty: SWK 601 (M700) - Fundamentals of Social Work Practice I (Fall 2026)

Viral Content Editor

Content Editor / Writer with Machine Learning Experience

Associate, Scoring Service

Part-Time Faculty: SWK 740 (M701) Treatment of Complex Trauma with Individuals (Fall 2026)

Marketing Coordinator

Information Specialist - Freelance AI Trainer Project

Umbundu Language Specialist - Freelance AI Trainer Project

Director of Training Content & Curriculum

Mongolian Language Specialist - Freelance AI Trainer Project

Social Media Coordinator

Email Marketing Specialist - Remote Job

I want to receive the latest job alert for content evaluation in remote

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected