Top 59434 Red Jobs | SimplyHired

Red Teaming Expert
mpathic —Seattle, WA
- $30 - $60 an hour
- Part-time
- Remote
- Mid-level
- Psychology
Quick Apply
Nurse Practitioner
Urrly —Hillsboro, OR
- $140 an hour
- Choose your own hours
- Background check
- Nursing
- Vital signs
- Paid training
- Flexible schedule
Quick Apply
Mechanical Technician II
Association of Universities for Research in Astronomy —Maui, HI
- $32 - $41 an hour
- Weekends as needed
- Computer literacy
- Mid-level
- Forklift
- Paid time off
- Retirement plan
Dishwasher
Red Lobster —DuBois, PA
- Part-time
- Ability to lift 50 pounds
- US work authorization
- Restaurant
- Disability insurance
- Health insurance
Licensed Acupuncturist
Integrated Health Solutions —Vancouver, WA
- $40 - $60 an hour
- 8 hour shift
- Doctoral degree
- Mid-level
- Master's degree
- Health insurance
- Flexible schedule
Quick Apply
Consultor de Ventas o Líder de Equipos de Ventas
WindMar Home (by David Fonseca) —Puerto Rico
- $45,000 - $90,000 a year
- Contract
Quick Apply
Retinal Surgeon
Desert Retina —Las Vegas, NV
- $400,000 - $450,000 a year
- Full-time
- Private practice
- Surgery
- BC/BE
- Relocation assistance
- Health insurance
Quick Apply
Family Medicine or Med Peds Physician | Direct Primary Care
First Primary Care —Gainesville, GA
- Full-time
- Spanish
- Medicine
- Primary Care
- Health insurance
- Dental insurance
Quick Apply
10d
Family Medicine or Med Peds Physician | Direct Primary Care
First Primary Care —Corpus Christi, TX
- Full-time
- Spanish
- Medicine
- Primary Care
- Health insurance
- Dental insurance
Quick Apply
CNS-Educator, Oncology
Valley Medical Center —Renton, WA
- $104,383 - $156,575 a year
- Full-time
- Background check
- Nursing
- RN License
- Health insurance
- Dental insurance
Quick Apply
Nurse Extern
HCA Healthcare Trident Hospital —Charleston, SC
- Part-time
- BLS Certification
- Critical & Intensive Care
- Neurology
- Employee stock purchase plan
- 401(k) matching
Marine Asset Manager
Long Beach Yacht Club —Long Beach, CA
- $22 - $25 an hour
- Full-time
- CPR Certification
- Mid-level
- Ability to lift 50 pounds
- Health insurance
- Dental insurance
Quick Apply
Registered Nurse ED
Ascension —Brookfield, WI
- Part-time
- Nursing
- Patient monitoring
- RN License
- Disability insurance
- Health insurance
Registered Nurse ED
Ascension —Milwaukee, WI
- Full-time
- Nursing
- RN License
- PALS Certification
- Disability insurance
- Health insurance
Radiologic Technologist (Rad Tech)
ConvenientMD —Woodstock, VT
- Vital signs
- BLS Certification
- Urgent Care
- Disability insurance
- Health insurance
Quick Apply
Test Engineer - Fluids | New Glenn (Mid to Senior | D and 3rd Shift)
Blue Origin —Florida
- Background check
- Management
- Schematics
- Paid parental leave
- Paid holidays
Fuel Transport Driver
Red Mountain Truck Lines —Missoula, MT
- Up to $110,000 a year
- Full-time
- Clean driving record
- Hazmat Endorsement
- CDL A
- Health savings account
- AD&D insurance
Quick Apply
Cook
Red Lobster —DuBois, PA
- Part-time
- US work authorization
- Restaurant
- Entry level
- Disability insurance
- Health insurance
Registered Nurse -Emergency Dept
Ascension —Brookfield, WI
- Full-time
- Nursing
- Patient monitoring
- RN License
- Disability insurance
- Health insurance
Ingeniero de automatización (automation engineer)
Cushman & Wakefield Amazon —Santa Rosa, PR
- $80,000 a year
- Full-time
- Ability to climb stairs
- Ability to lift 50 pounds
- Leadership
- Health savings account
- Health insurance
7d

I want to receive the latest job alert for red

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Red Teaming Expert

mpathic -
Seattle, WA

Quick Apply

Job Details

Part-time
$30 - $60 an hour

Qualifications

AI chatbots
Script writing
Stress testing simulations
Role-playing teaching method
Qualitative data analysis
Spreadsheets
Security risk assessment investigation
Rubric-based evaluation
Testing and evaluation
Slack
Gap analysis
Mid-level
Threat assessment
Taxonomy
Behavior analysis
Psychology
Voice acting
Red flag analysis
Escalation handling
Model evaluation
Rubric-based test scoring
Content review
Psychology
Stress Testing

Full Job Description

About mpathic.ai

Keeping the human in AI. mpathic is a trusted leader in advancing quality and safety in AI systems through expert-led evaluation and human data. We partner with leading technology companies to support red teaming, trust & safety, expert annotation, and model evaluation across high-stakes domains.

About the Role

mpathic is seeking part-time, project-based Red Teaming Experts to support a red-teaming and evaluation campaign focused on AI safety and model behavior in sensitive, real-world interactions.

In this role, you will design, simulate, and evaluate conversations with AI systems to assess safety, risk, and behavioral performance. You will identify failure modes, edge cases, and policy gaps—particularly in scenarios involving distress, ambiguity, or escalation.

This role involves roleplaying and reviewing clinical scenarios with AI agents. As such, we are ideally seeking candidates who bring creative or performance-driven strengths, as these competencies enhance the realism, nuance, and emotional depth needed for AI safety testing. Examples of these can include, but are not limited to:

Theatre degrees or studies
Acting, theatre, improv, or voice-over experience

Strong writing skills, especially dialogue or scenario writing

Experience creating or inhabiting characters (e.g., performers, TTRPG roleplay, narrative designers)

Conversational design, interaction writing, or scripted roleplay experience

Participation in gaming, interactive storytelling, or digital communities where roleplay is common

What You’ll Be Working On

You will help identify, prevent, and characterize risks that emerge when users interact with AI systems.

Responsibilities may include:

Designing and executing red-teaming scenarios across diverse user behaviors
Reviewing AI-generated responses for safety, accuracy, and policy compliance
Identifying failure modes, edge cases, and behavioral risks
Assessing whether AI appropriately recognizes and responds to distress or escalation
Evaluating tone, boundaries, and appropriateness in sensitive interactions
Detecting misleading, overconfident, or unsafe responses
Evaluating multi-turn conversations for consistency and risk handling
Identifying gaps in responses, including missed signals or incomplete handling
Conducting qualitative analysis to identify behavioral patterns and system weaknesses
Documenting edge cases, failure patterns, and safety risks
Applying or contributing to evaluation rubrics, taxonomies, and frameworks
Supporting quality assurance (QA) to ensure consistency across evaluations
Collaborating with internal teams on AI safety and evaluation improvements
Participating in red teaming exercises to surface system vulnerabilities
Maintaining strict confidentiality and quality standards

What We’re Looking For

Successful candidates are detail-oriented, analytically strong, and experienced in evaluating or stress-testing AI systems in complex or high-risk scenarios.

Professional experience in one or more of the following:

LLM red teaming or AI safety evaluation
Trust & safety, content moderation, or policy enforcement
AI/ML evaluation, annotation, or QA workflows
Conversational analysis or behavioral risk assessment
Work involving sensitive or high-stakes user interactions

Strong understanding of:

AI safety principles and common failure modes
Behavioral risk, escalation patterns, and edge-case handling
Mental health sensitivity, boundaries, and responsible AI behavior
How users express distress, confusion, or harmful intent in conversation

Ability to identify:

Safety violations and policy gaps
Missed or mishandled risk signals
Unsafe, misleading, or overconfident responses
Inappropriate tone or boundary-setting
Failures in escalation, de-escalation, or resolution
Inconsistencies across multi-turn interactions

Experience with or Interest in:

Red teaming methodologies and adversarial testing
Evaluating conversational AI systems or chatbots
Developing or applying evaluation frameworks and rubrics
Understanding how AI systems perform under real user behavior

Comfort with:

Tech tools and platforms (Slack, spreadsheets, dashboards)
Evaluating AI-generated responses (no coding required, but must be tech-comfortable)
Ambiguity, iteration, and feedback-driven workflows

Willingness to:

Sign NDAs and work with sensitive or high-impact content

Nice to Have (Not Required)

Background in mental health, behavioral science, or psychology
Experience in QA, annotation, or qualitative analysis
Experience with AI systems in sensitive domains (e.g., healthcare, safety)
Familiarity with evaluation metrics or safety frameworks

Compensation

$30-60/hour, depending on experience and specific project tasks/difficulty

Quick Apply

Refine Your Search

red jobs

Red Teaming Expert

Nurse Practitioner

Mechanical Technician II

Dishwasher

Licensed Acupuncturist

Consultor de Ventas o Líder de Equipos de Ventas

Retinal Surgeon

Family Medicine or Med Peds Physician | Direct Primary Care

Family Medicine or Med Peds Physician | Direct Primary Care

CNS-Educator, Oncology

Nurse Extern

Marine Asset Manager

Registered Nurse ED

Registered Nurse ED

Radiologic Technologist (Rad Tech)

Test Engineer - Fluids | New Glenn (Mid to Senior | D and 3rd Shift)

Fuel Transport Driver

Cook

Registered Nurse -Emergency Dept

Ingeniero de automatización (automation engineer)

I want to receive the latest job alert for red

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected