AI Red Teamer, LLM Generalist
Handshake —Seattle, WA
- $32 - $95 an hour
- Contract
- Writing skills
- Research
- Mid-level
Quick Apply
AI QA Trainer - LLM Evaluation - Freelance Project
Meridial —Remote
- $6 - $65 an hour
- Remote
- Computer Science
- Master's degree
- SQL
AI Red Team Lead Engineer
U.S. Bank National Association —Atlanta, GA
- $133,365 - $156,900 a year
- Full-time
- System design
- Office
- 8 years
- Paid holidays
- Disability insurance
Data Scientist 5 - AI Evals
Netflix —Remote
- $372,000 - $600,000 a year
- Computer Science
- System design
- Doctor of Philosophy
- Paid holidays
- Health insurance
Enterprise Data Security Architect
Resolution Technologies —Duluth, GA
- Hybrid work
- Azure
- System design
- HIPAA
- Health savings account
- Disability insurance
14d
Senior AI Developer
myDNA, Inc. —Houston, TX
- Full-time
- Computer science
- Computer Science
- Bachelor of Science
- Health savings account
- Disability insurance
Quick Apply
10d
Staff AI Scientist
Fiddler AI —Palo Alto, CA
- $175,000 - $260,000 a year
- Full-time
- Hybrid work
- 7 years
- Computer Science
- Office
- Paid parental leave
- Dental insurance
Quick Apply
Linguist II (AI/LLM)
Prolim global system —Washington, DC
- $50 - $60 an hour
- Contract
- Remote
- Computer Science
- Mid-level
- Master's degree
Quick Apply
3d
Senior Engineer, Digital Products
NDWA —Remote
- $130,000 - $140,000 a year
- Temporary
- Remote
- 7 years
- Organizational skills
- Senior level
Quick Apply
Research Engineer
Lotus Health AI —San Francisco, CA
- Full-time
- SQL
- Senior level
Staff Software Engineer
Uber —Sunnyvale, CA
- $232,000 - $258,000 a year
- Full-time
- Computer Science
- Bachelor's degree
- Mentoring
AI Evaluation Subject Matter Expert
Foxhole Technology —Charleston, SC
- Computer Science
- Analysis skills
- Math
Quick Apply
Principal Software Engineer
Amgen —Thousand Oaks, CA
- $157,020.50 - $212,439.50 a year
- Computer science
- Azure
- Doctoral degree
- Disability insurance
- Health insurance
AI Engineer
AAIT Health LLC —Little Rock, AR
- Full-time
- Azure
- HIPAA
- Mid-level
Quick Apply
AI Engineer
Confie Administrative Services Inc —Addison, TX
- $110,000 - $140,000 a year
- Hybrid work
- Computer science
- Azure
- Computer Science
- Health insurance
- Dental insurance
Quick Apply
Sr. Principal, AI Delivery Lead, Tech Program Manager
Northern Trust Corp. —Chicago, IL
- $137,400 - $240,400 a year
- Full-time
- Microsoft Excel
- Azure
- 5 years
- Health insurance
- Dental insurance
Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare AI
Deloitte —Philadelphia, PA
- $110,700 - $379,200 a year
- Full-time
- Computer Science
- Up to 50% travel
- System design
Expert Senior Manager, AI Engineering
Bain & Company Inc —Atlanta, GA
- $258,000 - $293,500 a year
- Full-time
- System design
- Continuous improvement
- Product management
- Wellness program
- Paid holidays
Principal AI Architect/Engineer
PepsiCo —Plano, TX
- $110,700 - $185,250 a year
- On call
- Azure
- 6 years
- Computer Science
- Paid parental leave
- Health insurance
Associate Director, AI/ML Engineering
Acadia Pharmaceuticals Inc. —San Diego, CA
- $172,000 - $215,000 a year
- Hybrid work
- Computer science
- 7 years
- Computer Science
- Paid parental leave
- Employee stock purchase plan

I want to receive the latest job alert for hallucination red teaming prompt

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

hallucination red teaming prompt jobs near

AI Red Teamer, LLM Generalist

Handshake -
Seattle, WA

Quick Apply

Job Details

Contract
$32 - $95 an hour

Qualifications

Research

Full Job Description

About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

Why join Handshake now:

Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

About the Role
As an AI Red Teamer, you will stress-test large language models by intentionally trying to break them. Rather than checking whether an answer is correct, you will design creative, adversarial prompts that expose vulnerabilities: unsafe content, bias, broken guardrails, hallucinations, prompt injection weaknesses, and unexpected behaviors. Your work directly supports AI safety and model robustness for leading research labs.

This is a generalist red teaming role. You will probe models across the full spectrum of risk categories, including content safety, CBRN (chemical, biological, radiological, nuclear), cybersecurity, persuasion and influence operations, child safety, self-harm, over-companionship, and regulatory compliance. Red teaming may span text, image, voice, and agentic model capabilities depending on project needs.

This role requires creativity, curiosity, and an ability to think like an adversary while operating with strong ethical judgment.

Craft creative prompts and multi-turn scenarios to stress-test AI guardrails across diverse risk categories
Discover ways around safety filters, restrictions, and defenses using jailbreak, evasion, and prompt injection techniques
Explore edge cases to provoke disallowed, harmful, or incorrect outputs
Evaluate and score model responses against structured harm taxonomies and severity rubrics
Document experiments clearly, including what you tried, why you tried it, and what it revealed
Review and refine adversarial prompts generated by other team members
Contribute to harm taxonomy development, calibration exercises, and inter-rater reliability work
Collaborate with engineers, data scientists, and researchers to share findings and strengthen defenses
Work with potentially disturbing content on a regular basis (see Content Warning below)
Stay current on jailbreaks, attack methods, and evolving model behaviors

Desired Capabilities

Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.)
Intuition for crafting adversarial prompts; familiarity with jailbreak or evasion techniques is a strong plus
Creative, adversarial problem-solving skills
Clear and thoughtful written communication
Strong ethical judgment and the ability to separate adversarial thinking from personal values
Self-directed, collaborative, and comfortable in feedback-heavy environments
Curiosity, persistence, and comfort with frequent failure in experimentation

Extra Credit

Familiarity with Python or other scripting languages
Experience working with LLM APIs or evaluation tooling
Comfort with structured data annotation and rubric-based scoring
Prior work in trust and safety, content moderation, QA, or security research
Subject matter expertise in any high-risk domain (cybersecurity, chemistry, biology, medicine, law, finance, etc.)

You Will Thrive Here If

You treat every model response as a hypothesis to challenge
You can switch between creative free-association and rigorous documentation in the same session
You go deep into unusual interests (fandoms, niche internet cultures, gaming exploits, Wikipedia rabbit holes, etc.)
You come from a creative background: writing, visual art, improv, puzzle design, or similar
You are energized by finding the thing nobody else thought to try
You are genuinely passionate about AI and follow the space closely

Content Warning

This role involves regular and deliberate exposure to harmful content. You will encounter and intentionally generate content involving violence, self-harm, hate speech, sexually explicit material, child safety scenarios, and other categories of harmful output as part of structured adversarial testing. Candidates must be able to engage with this material professionally and sustainably. Support resources are available.

Quick Apply

Refine Your Search

hallucination red teaming prompt jobs

AI Red Teamer, LLM Generalist

AI QA Trainer - LLM Evaluation - Freelance Project

AI Red Team Lead Engineer

Data Scientist 5 - AI Evals

Enterprise Data Security Architect

Senior AI Developer

Staff AI Scientist

Linguist II (AI/LLM)

Senior Engineer, Digital Products

Research Engineer

Staff Software Engineer

AI Evaluation Subject Matter Expert

Principal Software Engineer

AI Engineer

AI Engineer

Sr. Principal, AI Delivery Lead, Tech Program Manager

Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare AI

Expert Senior Manager, AI Engineering

Principal AI Architect/Engineer

Associate Director, AI/ML Engineering

I want to receive the latest job alert for hallucination red teaming prompt

Explore jobs in more locations

About Handshake

Desired Capabilities

Extra Credit

You Will Thrive Here If

Content Warning

Job Seeker Tools

Employer Tools

Browse

Stay Connected