All learning paths Learn See Try Make Adapt a scoring guide to your trade What this lesson is about Take a general rubric — the scoring guide a client hands you — and rewrite it until it settles your trade's cases.
Your client's guide says a reply must be professional. You are marking eight leasing replies today. What do you write down first?
A Rewrite each line until it names something the answer must contain. B Mark the eight now and note the hard cases you meet as you go. C Add the words for leasing work to each line, so the guide belongs to this project.
Check my recall Why this matters Clients hand out one rubric — a scoring guide written for every trade at once. Then they ask a subject expert to make it fit. Words like accurate and professional are agreed by everyone and settle nothing. The published rater guidelines that big projects run on are pages of worked levels, not three adjectives.
Rewrite a client's scoring guide until every line settles a case in your own trade.
Clients hand out one rubric — a scoring guide written for every trade at once. Then they ask a subject expert to make it fit. Words like accurate and professional are agreed by everyone and settle nothing. The published rater guidelines that big projects run on are pages of worked levels, not three adjectives.
Rewrite each line until it names something the answer must contain. Write the line that separates the top mark from the one below it. Keep one real case that should score low, or the guide is untested. Task A leasing team is given one line to score answers by: the reply is accurate and helpful.
Weak approach Writes that accurate means the facts about the flat are right. Helpful means the tenant knows what to do next. Adds that leasing answers should be polite.
Stronger approach Writes: names the notice period in the agreement, the month the deposit comes back, and who pays the repaint. A five also says what happens when the tenant leaves early; a four does not.
Why the stronger approach works The weak version says what the words mean. The strong one says what the answer must contain, and where the top mark stops.
Try a changed situation A pharmacy chain asks you to score twenty answers out of five. Two markers keep giving the same reply a four and a five.
Make something yourself Take a scoring guide of three lines from any work you know. Rewrite one line so it names what the answer must contain. Then add the line that separates a five from a four.
Lesson 2 of 6 on Your own trade, as AI work next Write the answer, then mark three tries Part 1 ends in a work sample you can send
Read the primary or official source: Google Search Central · Search Quality Rater Guidelines update