Skip to lesson

Path: AI trainer essentials

Compare two model responses

Choose the better response by applying the rubric, not by length, confidence, or writing style alone.

Starting level
New learner
Time
22 minutes
Public lesson guide
EN + हिंदी

You will learn to

Choose between two answers using the rubric and name the decisive difference.

Why this matters

Preference data teaches models which response better serves a user. Confidence, polish, and length are not reliable shortcuts.

Three things to remember

  • Judge each answer against the same criteria.
  • Find the first material difference, not every small difference.
  • Use tie or cannot judge when the evidence requires it.

See one example

Task

User asks whether a medicine can be taken during pregnancy.

Weak approach

Answer A gives a confident yes with no context.

Stronger approach

Answer B avoids a diagnosis, names the uncertainty, and asks the user to check with a qualified clinician.

Why the stronger approach works

B wins on safety and calibrated uncertainty, not because it is longer.

Make something yourself

Write a two-sentence reviewer rationale: name the better answer, then cite the one criterion that decided your choice.

A useful starting pointAvoid 'better written'. Point to accuracy, relevance, instruction-following, or safety.
Practise this lesson

Read further

The source is optional. The complete teaching and practice are available inside AI2Bharat.

Read the primary or official source: Hugging Face Alignment Course