Robotic Manipulation Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.
Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.
-
Review robotics review outputs against current safety standards and operating envelopes for Robotic Manipulation Task Evaluator assignments.
-
Grade perception, motion, and decision logic on a structured rubric.
-
Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
-
Capture the corrected behavior or reference trajectory so the modeling team can train on it.
-
Adjudicate disputed cases against published standards or firm operating procedures.
-
Maintain reviewer-quality scores in inter-rater calibration cycles.
-
Hands-on experience operating, supervising, or evaluating robotic, autonomous, or teleoperated systems for Robotic Manipulation Task Evaluator work.
-
Comfort reasoning about perception, motion planning, and physical safety envelopes.
-
Familiarity with structured incident taxonomies and severity scoring.
-
Clear written reasoning that names the failure mode and the standard being applied.
-
Reliable async availability for at least 10 hours per week.
-
Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
-
Score a perception output against ground-truth labels and rate the failure category.
-
Adjudicate a disputed safety call between two reviewers using firm operating procedures.
-
Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.
-
Background in robotics engineering, autonomy operations, or industrial safety.
-
Prior experience reviewing AI-assisted robotics tooling and its failure modes.
-
Familiarity with simulation environments and trajectory-replay tooling.
-
Robotics evaluation
-
Perception review
-
Motion safety
-
Incident taxonomy
-
Robotics review
-
Embodied AI
-
Safety review
-
Robotic
-
Manipulation
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Hourly rate confirmed after the interview process.
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
