Path: AI trainer essentials
Review the conversation, not one reply
Judge a reply against what the conversation already fixed: the user's constraints, corrections and stated language.
- Starting level
- Comfortable with the basics
- Time
- 22 minutes
- Public lesson guide
- EN + हिंदी
You will learn to
Judge each reply against the constraints, corrections and facts the conversation already fixed.
Why this matters
Single-reply review passes conversations that quietly drop what the user asked for three turns ago.
Three things to remember
- A standing instruction holds until the user changes it.
- Check each reply against the earlier turns, not on its own.
- Mark the turn where the conversation first broke, not the last one.
See one example
A four-turn chat about filling a scholarship form; the user asked for Hindi in turn one.
Try the judgement yourself
Both answers respond to the task above. One of them does the job better. Which, and why?
Make something yourself
Take a four-turn chat you have had with an assistant. For each turn, write the one thing it had to carry forward from an earlier turn, and say whether it did.
Read further
The source is optional. The complete teaching and practice are available inside AI2Bharat.
Read the primary or official source: Anthropic HH-RLHF