Member of Technical Staff, Head of Quality
Plato —San Francisco, CA
- $180,000 - $280,000 a year
- Full-time
- 3 years
- Machine learning
- Senior level
Quick Apply
1d
Full-Stack Software Engineer, Reinforcement Learning
Anthropic —San Francisco, CA
- $300,000 - $405,000 a year
- Hybrid work
- Office
- AWS
- Bachelor's degree
- Parental leave
- Flexible schedule
Product Operations Manager, Meta Superintelligence Labs
Meta —San Francisco, CA
- $123,000 - $179,000 a year
- 8 years
- SQL
- Analysis skills
Annotation Operations Manager
Dyna Robotics —Redwood City, CA
- Full-time
- SQL
- Continuous improvement
- Scripting
Warehouse Team Member – Custom Packaging, 2nd Shift
Torani —San Leandro, CA
- $25.05 an hour
- Overtime
- Basic math
- Forklift
- Ability to lift 50 pounds
- Profit sharing
- Health insurance
Quick Apply
2d
Product Operations Engineer
Happyrobot Inc. —San Francisco, CA
- $150,000 - $180,000 a year
- Full-time
- Hybrid work
- 3 years
- Analysis skills
- APIs
- Health insurance
- Dental insurance
Automation Service Engineer II
Guardant Health —Redwood City, CA
- $91,800 - $148,500 a year
- Weekends as needed
- Hybrid work
- Background check
- Bachelor of Science
- Mid-level
11d
Assembler II (Seasonal, 12 weeks) / Ensamblador II (Temporada)
EO Products —San Rafael, CA
- From $22.35 an hour
- Seasonal
- High school diploma or GED
- Ability to lift 50 pounds
- Warehouse
- Paid holidays
- Health insurance
Quick Apply

Discover related jobs

Based on your search for data labeler jobs.

Principal Data Scientist - AI Trainer
DataAnnotation —San Mateo, CA
A bachelor's degree in a quantitative field preferred (Statistics, Computer Science, Mathematics, Engineering, or similar); an advanced degree (Master’s or PhD)…
$50 - $100 an hour
Quick Apply
Economic Analyst - AI Trainer
DataAnnotation —Sunnyvale, CA
A bachelor's degree in a quantitative field preferred (Statistics, Computer Science, Mathematics, Engineering, or similar); an advanced degree (Master’s or PhD)…
$50 - $100 an hour
Quick Apply

Show more related jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Maintenance Reliability Technician (MRT) (7295)
Hikma Pharmaceuticals —Columbus, OH
Minimum of 4-years total experience in a technical field. Perform preventive, corrective, or emergency work orders and respond to service calls while the plant…
From $24 an hour
Quick Apply
Characterization Process Development Specialist
Validation & Engineering Group, Inc —New Albany, OH
Ability to develop clear technical reports, protocols, executive summaries, and documentation based on engineering data.
Quick Apply

Show more jobs in cities nearby

I want to receive the latest job alert for data labeler in san francisco ca

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

data labeler jobs near san francisco ca

Operations Manager jobs in Redwood City, CA

Warehouse Worker jobs in San Leandro, CA

Full Stack Developer jobs in San Francisco, CA

Data Engineer jobs in San Francisco, CA

Senior Assembler jobs in New Jersey

Siena Lakes By Erickson Senior Living jobs in Naples, FL

Senior Assembler jobs in California

Remote Senior Accountant jobs in San Francisco Bay Area, CA

Senior Assembler jobs in San Diego, CA

Senior Part Time jobs in Dayton, OH

Senior Assembler jobs in Otsego, MI

Senior Marketing Manager jobs in Denver, CO

Automation Engineer jobs in West Palm Beach, FL

Automation Engineer jobs in Lancaster, PA

Haas Automation jobs in Oxnard, CA

Ai Automation jobs in Remote

Automation Engineer jobs in Los Angeles, CA

Automation Engineer jobs in Rockville, MD

Operations Manager jobs in Tyler, TX

Logistics Manager jobs in Greenville, SC

Member of Technical Staff, Head of Quality

Plato -
San Francisco, CA

Quick Apply

Job Details

Full-time
$180,000 - $280,000 a year
1 day ago

Qualifications

AI models
Data quality checks
Software engineering
Reinforcement learning
Team leadership
Software quality assurance team management
Research project technical leadership

Full Job Description

About Plato

Plato is an applied research lab building the environments used to train specialized AI agents. We turn proprietary real-world data into high-fidelity simulations that produce the dense reinforcement learning signal required to train frontier models.

Compute and baseline architectures are rapidly commoditizing; environment design and RL data are the true bottlenecks. Today, models don’t fail from a lack of compute—they fail because bad task design, leaky reward functions, and brittle verifiers train them to cheat instead of learn. Plato exists to make RL signal provable, grounded, and robust at scale.

We’re based in San Francisco and backed by leading investors and researchers across top frontier labs.

Why Apply

Own the Ground Truth: You will own the final checkpoint between raw environments and customer model runs. If an environment teaches a model the wrong behavior, you pull the plug.
Massive Leverage: We don’t solve quality by throwing armies of manual labelers at a spreadsheet. You will architect the automated judge harnesses, red-teaming agents, and telemetry that enforce quality programmatically.
Founding Impact: As Head of Quality (Member of Technical Staff), you will build Plato’s QA systems from scratch, set the technical bar, and scale the team.
Frontier Signal: Work directly on the failure modes frontier labs face when scaling post-training, test-time compute, and agentic workflows.

The Role

In RL, quality is not a polish step—it is the training signal itself.

When task designs are ambiguous, sandboxes lack proper isolation, or reward functions contain loopholes, agents do what optimizers always do: exploit the grader. A broken environment doesn’t just burn cluster hours; it actively poisons downstream model weights.

As Head of Quality, you will own the standard for what constitutes real learning signal across every task, verifier, and environment Plato ships. You’ll be the adversarial mind finding the loopholes before the model does, the engineer automating the test suites, and the leader directing the team running verification.

What You’ll Do

Gate Final Delivery: Own the final sign-off before environments and datasets ship to frontier labs, auditing trajectories, tasks, and reward dynamics for correctness, feasibility, and signal density.
Harden Verifiers & Tasks: Build automated red-teaming suites to stress-test task feasibility and verifier integrity, aggressively eliminating reward hacking, grader tampering, and impossible task traps.
Automate Verification Infra: Architect judge models, sandbox replay harnesses, and rollout forensics to catch synthetic drift, out-of-distribution behaviors, and leaky states upstream.
Build & Lead the Verification Team: Hire and direct a high-agency team of QA engineers, domain specialists, and technical reviewers, blending automated agentic checks with deep human-in-the-loop review.
Close the Loop with Research: Translate downstream model failure modes into concrete generator constraints so defects are prevented at the generation stage rather than caught in review.

Required Qualifications

Technical Depth in ML/RL or Systems: 3+ years of experience in software engineering, ML engineering, or research systems, with proficiency in modern languages (Python, etc.).
Adversarial Systems Instinct: You understand how optimizers exploit edges. You naturally think about how an agent could game a reward function, break a sandbox, or fake completion.
Trajectory & Code Forensics: Proven ability to dive into raw rollouts, agent reasoning traces, and verification code to spot subtle ungrounded assumptions or hallucinated logic.
High-Agency Leadership: Experience building or leading a technical evaluation, QA, or data verification function from zero to one.
Zero-Compromise Bar: Comfort holding the line on delivery under intense customer pressure. You understand that shipping contaminated data is far worse than shipping late.

Preferred Qualifications

Experience with RL training dynamics, automated LLM evals, agent sandboxing, or synthetic trajectory generation.
Background designing adversarial test suites, code execution verifiers, or formal verification systems.
Experience handling client-facing technical evaluations and failure postmortems with frontier AI research teams.Introduction

Plato is an applied research lab building the foundational infrastructure to train specialized AI agents.

We turn real-world data streams into high-fidelity simulated environments that generate the training signal needed to make capable models. Our work supports frontier labs, hyperscalers, and enterprises building AI systems for complex, high-stakes work.

Today, only a handful of players can train models for capable work. Compute and algorithms are rapidly commoditizing, but reinforcement learning data remains the bottleneck. Plato is changing that by automatically scaling training environments from proprietary real-world data.

Compensation Range: $180K - $280K

Quick Apply

Refine Your Search

data labeler jobs in san francisco ca

Member of Technical Staff, Head of Quality

Full-Stack Software Engineer, Reinforcement Learning

Product Operations Manager, Meta Superintelligence Labs

Annotation Operations Manager

Warehouse Team Member – Custom Packaging, 2nd Shift

Product Operations Engineer

Automation Service Engineer II

Assembler II (Seasonal, 12 weeks) / Ensamblador II (Temporada)