All learning paths Learn See Try Make Report a run in numbers What this lesson is about Say how many runs, how many broke, how long each took, and what you changed. No adjectives.
The shop owner is about to pay you for another month and asks how last week went. What do you send him?
A The count of runs, and a line saying the week went well after the fix. B The shop's own sales figures for the week, since that is what he cares about. C Report runs, failures, minutes and the change you made, with no adjectives.
Check my recall Why this matters Build the measures first, then measure the difference a change made. A report of adjectives cannot be compared with next month's. A report of numbers can.
Report a week of a workflow in numbers a buyer can check, and name what you did not measure.
Build the measures first, then measure the difference a change made. A report of adjectives cannot be compared with next month's. A report of numbers can.
Report runs, failures, minutes and the change you made, with no adjectives. Give the before and the after of the same measure, or the number says nothing. Say what you did not measure, inside the report itself. Task A shop owner asks how last week went before paying for another month of your workflow.
Weak approach Says the workflow runs much better now, especially after Wednesday's change. The owner should be happy with the week. There is no count of anything in the message.
Stronger approach Sends five numbers: 60 runs started, 9 broke before Wednesday's fix and 3 after. Each run took a little over 4 minutes. The shop was shut on 2 of the 7, and nothing was counted then.
Why the stronger approach works The strong one can be compared with next month. It also names the gap, so nobody discovers it later and stops believing the rest.
Try a changed situation You are telling your family whether a new water pump saved money this month. Which rule still applies?
Make something yourself Report one week of a workflow you run. Give the number of runs, the failures, the minutes, the one change you made, and what you did not measure.
Lesson 9 of 9 on Running and checking AI agents next What an open model really gives you Part 3 ends in a work sample you can send The rules this work sample is read against
Read the primary or official source: Google · Rules of machine learning