All learning paths Learn See Try Make Add the check that stops the break What this lesson is about After a failure, write the small check that would have caught it, and put it in the run itself.
Your bill-filing agent sent the same shop bill twice last week. It has not been touched since. What do you do now?
A Write the double bill in your weekly notes, and look for it by hand each Friday. B After every failure, put the smallest check that would have caught it inside the run. C Rebuild the whole filing step so it reads every past bill before it files anything.
Check my recall Why this matters An agent that failed once will fail the same way again. These systems fail quietly: the run keeps going while the answers get worse. A check inside the run is what notices.
After a failure, add the smallest check that would have caught it, inside the run itself.
An agent that failed once will fail the same way again. These systems fail quietly: the run keeps going while the answers get worse. A check inside the run is what notices.
After every failure, put the smallest check that would have caught it inside the run. A check somebody has to remember to run is not a check. Prove it works by running the failing case through it again. Task An agent filed one shop bill twice last week, because the sheet carried the same row twice.
Weak approach Adds a line to the instructions asking the agent to watch out for repeated rows. Nothing in the run itself changed, and the same sheet would still pass through it.
Stronger approach Adds one line inside the workflow: if this bill number is in the filed list, stop and say so. Re-runs last week's sheet and shows it stopping at the repeated row.
Why the stronger approach works The strong one is inside the run and was proved on the case that broke. The weak one asks the agent to be careful.
Try a changed situation Your cousin's shop counts its cash by hand each night and often skips it. Which rule still applies?
Make something yourself Describe one failure in a workflow you run. Write the small check you added inside the run. Show the same failing case before the check and after it.
Lesson 7 of 9 on Running and checking AI agents next Hand a workflow over to somebody Part 3 ends in a work sample you can send
Read the primary or official source: Google · Rules of machine learning