Top 65871 Red Jobs | SimplyHired

Red Teaming Expert
mpathic —Seattle, WA
- $30 - $60 an hour
- Part-time
- Remote
- Mid-level
- Psychology
Quick Apply
RED VEST Heroes
4th South Ace Hardware —Salt Lake City, UT
- Multiple hires
- Sales
- Entry level
Drumline Sponsor
Knoxville Community School District —Knoxville, IA
- Entry level
$4000+ a Month Aesthetician (No license required)
EM SERVICES LLC —Providence, RI
- $4,249.83 - $5,118.07 a month
- 8 hour shift
- Customer service
- In-person
- Entry level
- Paid training
- Employee discount
Quick Apply
Dishwasher
Red Lobster —State College, PA
- Part-time
- Ability to lift 50 pounds
- US work authorization
- Restaurant
- Disability insurance
- Health insurance
Host
Red Lobster —State College, PA
- Part-time
- Casual dining restaurant
- US work authorization
- Entry level
- Disability insurance
- Health insurance
Dishwasher
Red Lobster —DuBois, PA
- Part-time
- Ability to lift 50 pounds
- US work authorization
- Restaurant
- Disability insurance
- Health insurance
Physician Assistant
Potomac Healthcare Solutions —Fort Hood, TX
- Full-time
- BLS Certification
- Mid-level
- Bachelor's degree
- Wellness program
- Health savings account
Quick Apply
Mechanical Technician II
Association of Universities for Research in Astronomy —Maui, HI
- $32 - $41 an hour
- Weekends as needed
- Computer literacy
- Mid-level
- Forklift
- Paid time off
- Retirement plan
To Go Specialist
Red Lobster —State College, PA
- Part-time
- US work authorization
- Restaurant
- Entry level
- Disability insurance
- Health insurance
Registered Nurse - Psychiatry
Matrix Providers —Albuquerque, NM
- $42.40 - $49.40 an hour
- Full-time
- Psychiatry
- Bachelor of Science
- Mid-level
- Paid holidays
- Health insurance
Quick Apply
Cook
Red Lobster —State College, PA
- Part-time
- US work authorization
- Restaurant
- Entry level
- Disability insurance
- Health insurance
Reg Professional Nurse
The William George Agency for Childrens Serv —Freeville, NY
- $38 - $48 an hour
- Full-time
- CPR Certification
- Nursing
- Blood sampling
Quick Apply
14d
Cook
Red Lobster —DuBois, PA
- Part-time
- US work authorization
- Restaurant
- Entry level
- Disability insurance
- Health insurance
Direct Primary Care Provider - (M-F, No Weekends/Holidays)
Hy-Vee Health Exemplar Care —Dubuque, IA
- $1 - $10 a year
- Full-time
- Primary Care
- Mid-level
- In-person
- Travel reimbursement
- Health insurance
Quick Apply
Paramedic
Lakeview Hospital —Stillwater, MN
- $30.90 - $46.14 an hour
- Weekends as needed
- CPR Certification
- PALS Certification
- Hospital
- Health insurance
Assistant Nurse Manager Hospital - Neuro Expansion
Cleveland Clinic —Cleveland, OH
- $39.50 - $59.60 an hour
- 12 hour shift
- Nursing
- Surgery
- RN License
- Dental insurance
- Vision insurance
OB/GYN Physician
Unified Women's Healthcare —Las Vegas, NV
- $300,000 - $325,000 a year
- Full-time
- Private practice
- Hospital
- BC/BE
- Dental insurance
- Vision insurance
Physician - Lancaster PA
Physicians Vein Clinics —Lancaster, PA
- $210,000 - $280,000 a year
- Full-time
- Background check
- Medicine
- Surgery
- Paid holidays
- Relocation assistance
Quick Apply
Ultrasound Technologist - Casual
Fairview Health Services —Wyoming, MN
- $43.65 - $63.04 an hour
- Hospital
- BLS Certification
- Mid-level

I want to receive the latest job alert for Red

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Red Teaming Expert

mpathic -
Seattle, WA

Quick Apply

Job Details

Part-time
$30 - $60 an hour

Qualifications

AI chatbots
Script writing
Stress testing simulations
Role-playing teaching method
Qualitative data analysis
Spreadsheets
Security risk assessment investigation
Rubric-based evaluation
Testing and evaluation
Slack
Gap analysis
Mid-level
Threat assessment
Taxonomy
Behavior analysis
Psychology
Voice acting
Red flag analysis
Escalation handling
Model evaluation
Rubric-based test scoring
Content review
Psychology
Stress Testing

Full Job Description

About mpathic.ai

Keeping the human in AI. mpathic is a trusted leader in advancing quality and safety in AI systems through expert-led evaluation and human data. We partner with leading technology companies to support red teaming, trust & safety, expert annotation, and model evaluation across high-stakes domains.

About the Role

mpathic is seeking part-time, project-based Red Teaming Experts to support a red-teaming and evaluation campaign focused on AI safety and model behavior in sensitive, real-world interactions.

In this role, you will design, simulate, and evaluate conversations with AI systems to assess safety, risk, and behavioral performance. You will identify failure modes, edge cases, and policy gaps—particularly in scenarios involving distress, ambiguity, or escalation.

This role involves roleplaying and reviewing clinical scenarios with AI agents. As such, we are ideally seeking candidates who bring creative or performance-driven strengths, as these competencies enhance the realism, nuance, and emotional depth needed for AI safety testing. Examples of these can include, but are not limited to:

Theatre degrees or studies
Acting, theatre, improv, or voice-over experience

Strong writing skills, especially dialogue or scenario writing

Experience creating or inhabiting characters (e.g., performers, TTRPG roleplay, narrative designers)

Conversational design, interaction writing, or scripted roleplay experience

Participation in gaming, interactive storytelling, or digital communities where roleplay is common

What You’ll Be Working On

You will help identify, prevent, and characterize risks that emerge when users interact with AI systems.

Responsibilities may include:

Designing and executing red-teaming scenarios across diverse user behaviors
Reviewing AI-generated responses for safety, accuracy, and policy compliance
Identifying failure modes, edge cases, and behavioral risks
Assessing whether AI appropriately recognizes and responds to distress or escalation
Evaluating tone, boundaries, and appropriateness in sensitive interactions
Detecting misleading, overconfident, or unsafe responses
Evaluating multi-turn conversations for consistency and risk handling
Identifying gaps in responses, including missed signals or incomplete handling
Conducting qualitative analysis to identify behavioral patterns and system weaknesses
Documenting edge cases, failure patterns, and safety risks
Applying or contributing to evaluation rubrics, taxonomies, and frameworks
Supporting quality assurance (QA) to ensure consistency across evaluations
Collaborating with internal teams on AI safety and evaluation improvements
Participating in red teaming exercises to surface system vulnerabilities
Maintaining strict confidentiality and quality standards

What We’re Looking For

Successful candidates are detail-oriented, analytically strong, and experienced in evaluating or stress-testing AI systems in complex or high-risk scenarios.

Professional experience in one or more of the following:

LLM red teaming or AI safety evaluation
Trust & safety, content moderation, or policy enforcement
AI/ML evaluation, annotation, or QA workflows
Conversational analysis or behavioral risk assessment
Work involving sensitive or high-stakes user interactions

Strong understanding of:

AI safety principles and common failure modes
Behavioral risk, escalation patterns, and edge-case handling
Mental health sensitivity, boundaries, and responsible AI behavior
How users express distress, confusion, or harmful intent in conversation

Ability to identify:

Safety violations and policy gaps
Missed or mishandled risk signals
Unsafe, misleading, or overconfident responses
Inappropriate tone or boundary-setting
Failures in escalation, de-escalation, or resolution
Inconsistencies across multi-turn interactions

Experience with or Interest in:

Red teaming methodologies and adversarial testing
Evaluating conversational AI systems or chatbots
Developing or applying evaluation frameworks and rubrics
Understanding how AI systems perform under real user behavior

Comfort with:

Tech tools and platforms (Slack, spreadsheets, dashboards)
Evaluating AI-generated responses (no coding required, but must be tech-comfortable)
Ambiguity, iteration, and feedback-driven workflows

Willingness to:

Sign NDAs and work with sensitive or high-impact content

Nice to Have (Not Required)

Background in mental health, behavioral science, or psychology
Experience in QA, annotation, or qualitative analysis
Experience with AI systems in sensitive domains (e.g., healthcare, safety)
Familiarity with evaluation metrics or safety frameworks

Compensation

$30-60/hour, depending on experience and specific project tasks/difficulty

Quick Apply

Refine Your Search

Red jobs

Red Teaming Expert

RED VEST Heroes

Drumline Sponsor

$4000+ a Month Aesthetician (No license required)

Dishwasher

Host

Dishwasher

Physician Assistant

Mechanical Technician II

To Go Specialist

Registered Nurse - Psychiatry

Cook

Reg Professional Nurse

Cook

Direct Primary Care Provider - (M-F, No Weekends/Holidays)

Paramedic

Assistant Nurse Manager Hospital - Neuro Expansion

OB/GYN Physician

Physician - Lancaster PA

Ultrasound Technologist - Casual

I want to receive the latest job alert for Red

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected