All learning paths Learn See Try Make Line up video with other sensors What this lesson is about Match what the camera shows to what the other readings say, and mark the moments where they do not agree.
A twenty-second clip of a robot arm, and the arm's own joint numbers beside it. What comes before you write a time?
A Note the one moment where the two disagree most, and write that time down. B Match the camera against the other readings second by second, and mark where they differ. C Trust the joint numbers throughout, because a sensor does not blink like an eye.
Check my recall Why this matters The recording tool writes a frame's time from its place in the file. A run that slipped to 25 frames a second still claims 30. The motion then reads faster than it really was.
Line a clip up against the other readings and mark every moment the two disagree.
The recording tool writes a frame's time from its place in the file. A run that slipped to 25 frames a second still claims 30. The motion then reads faster than it really was.
Match the camera against the other readings second by second, and mark where they differ. A disagreement is not always an error. Say which reading you trust, and why. Write a time as a range wherever the edge is genuinely unclear. Task A twenty-second clip of a robot arm, with the arm's own joint readings beside it.
Weak approach Writing that the arm grips the block at six seconds, from the video alone.
Stronger approach The video shows contact near 6.0. The gripper reading closes at 6.4. Both are written down, with a note that the camera is trusted here because the fingers are visible.
Why the stronger approach works The weak version hides a gap of four tenths. The strong one records it and says which reading was preferred.
Try a changed situation There is no second sensor now. Two reviewers watching the same warehouse clip put the lift at different seconds. What goes in the record?
Make something yourself Take one clip with a second set of readings. Build a timing table of the camera events and the other readings, and list every place the two disagree.
Lesson 5 of 10 on Multimodal & physical AI next Mark where a machine must stop Part 2 ends in a work sample you can send
Read the primary or official source: Hugging Face · LeRobot, imitation learning on real robots