Learn
See
Try
Make

Review robot-action traces

What this lesson is about

Break an action into steps you can see. Then find the grasp, contact, motion or safety failure.

A packing arm drops a soap box halfway to the carton, and your note says the task failed. What do you write?

Why this matters

Physical AI data has to keep the timing, the contact and the cause. A label that only says the task failed teaches nothing about recovery.

Break a robot's behaviour into steps, and find the first failure you can see.

Physical AI data has to keep the timing, the contact and the cause. A label that only says the task failed teaches nothing about recovery.

Split approach, grasp, lift, move, and release.
Use views from the same moment before you decide they touched.
Record the first failure, and what it caused after that.

Task

A robot misses a block but continues its motion.

Weak approach Splits the run into approach, grasp, lift, move and release, and watches each one. Marks the failure at the tray, where the empty gripper finally shows. The grasp was already empty two steps earlier, and only the side view shows the fingers closing beside it.

Stronger approach The failure begins at the grasp. The fingers close beside the block, so the lift and the move carry an empty gripper.

Why the stronger approach works Both reviewers split the run and both named a step. One named the step where the fault showed, the other the step where it began.

Try a changed situation A second camera on the sorting line runs half a second behind the first. What do you do before writing that it held the fruit?

Make something yourself Write a pick-and-place trail in five steps. Give the time, the state, and the recovery action for each.

Lesson 3 of 10 on Multimodal & physical AInextMark when an event starts and endsPart 1 ends in a work sample you can send

Read the primary or official source: NVIDIA Physical AI