मेसिन फोरान। अंग्रेजी आर हिंदी फोरान थांबाय गाब।English हिन्दी

24 sections show the reviewed English text because a बर’ राव translation was not available for it.

Learn
See
Try
Make

रोबोटिक्स क्षेत्र बाय एकटा rubric अनुकूल करिबा

What this lesson is about

Take a client's rubric — the scoring guide that says helpful, safe, complete — and rewrite it for one robotics domain. Two raters should then decide twenty cases the same way twice.

A client's brief for scoring a warehouse arm says: mark each run as safe and useful. Twenty runs arrive tomorrow. What do you send back?

Why this matters

A published robot evaluation framework asks each rater for a progress score, a preference, and a reason. It leaves how to decide the preference to the rater. So raters often give two runs the same progress and still prefer one, for speed or confidence. That gap is where a rubric — the scoring guide — earns its place. Each criterion — one named quality you judge by — needs an anchor. The anchor is the line that says what a pass looks like in this domain.

Adapt a general scoring brief to one robotics domain, so two raters decide twenty cases the same way twice.

Rewrite helpful, safe and complete as four criteria, each anchored to a thing a camera or a clock shows.
Test it on twenty cases with two raters, twice; the splits that remain are the lines still to rewrite.
A split is a fault in the rubric, not in a rater. The case goes into the anchor, never into a note about the person.

Task

A client sends a brief for a floor-cleaning robot in a hospital ward: helpful, safe, complete. Adapt it.

Weak approach Adds the word ward to each line: helpful in the ward, safe in the ward, complete in the ward. Two raters then split on eleven of twenty runs, and the note blames the newer rater.

Stronger approach Writes four anchors. Complete: every marked tile passed over once. Safe: never within half a metre of a bed with a patient in it. Helpful: a cleaned tile is dry inside two minutes. Time: the ward done inside the twenty-minute slot. Two raters split on three of twenty, and each of the three goes into an anchor.

Why the stronger approach works The weak rubric changed the words and left the raters to judge. The strong one moved every judgement into a line both can see.

Try a changed situation Your rubric for a delivery robot went to two raters. They split on nine of twenty runs, and the client asks which rater to keep.

Make something yourself Take a generic helpful, safe, complete brief and adapt it to one named robotics domain. Then run twenty cases past two raters, twice.

Read the primary or official source: Atreya et al., RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies (arXiv)