Course › Module 5 · Candidate matching and ranking

Explainability: why did this candidate rank third?

Module 5, Lesson 4  ·  3 min read ·  Updated 21 September 2026

Module 5 · Lesson 4

If you cannot say why someone ranked where they did, you cannot defend the decision, improve your rules, or notice when the software is wrong. This is not a paperwork feature. It is what makes a ranking usable.

What a defensible ranking explanation containsA CV with two highlighted lines, each connected by an arrow to a scoring criterion showing how many points it carried.Candidate CVOrchestration experience25 of 100 pointsStated outcomes20 of 100 pointsA real explanation points at a line you can read
A real explanation points at a line in the CV you can read yourself.

What a real explanation contains

Four things. Anything less is a claim, not an explanation.

  1. Which rule it relates to.
  2. The evidence — a quote from the CV, not a summary of it.
  3. Where it came from in the document, so you can check.
  4. How much it counted, compared with the other rules.

Most tools give you the first and a paraphrase of the second. That is enough to spot-check and not enough to defend — worth knowing before someone asks you to defend it.

The deletion test

The fastest way to find out whether an explanation is real: take a test CV, delete the sentence the explanation quotes, run it again, and see what happens.

What happensWhat it means
Score drops, explanation changesThe explanation reflects what actually drove the score
Score drops, explanation identicalThe explanation is written separately from the scoring. Decoration
Score does not moveSomething else is driving the ranking. Find out what

Do this once per tool. Five minutes, and it tells you whether the explanations you are about to rely on for months are connected to anything.

Bands, not ranks

A ranked list suggests you can tell candidate six from candidate seven. You cannot. That gap is noise, as Module 4 explained.

Bands are honest about it. Three or four groups: strong match, worth reading, weak, filtered out. Inside a band, the order means nothing — and you should say so.

This also changes the conversation with a hiring manager. A ranked list invites "why is she above him", which has no answer. A banded list invites "which of these six do we start with", which is a real question.

Presenting it to a hiring manager

  • Lead with the rules, then the band, then the evidence. Never lead with a number.
  • Show one line of evidence per candidate per key requirement. It persuades better than any score and it makes disagreement productive.
  • Say what you are unsure about. "These two I could not verify from the CV" stops a false impression of completeness.
  • Never send a ranked list without the rules attached. A list with no rules is an opinion with a number on it.

Explaining it to a candidate

In some places candidates have a right to meaningful information about decisions made by software, and the direction of travel is towards more of that rather than less.

Practically: you should be able to tell a rejected candidate which requirement they did not meet, in plain words, without mentioning a score.

If the honest answer is "the system ranked you 340th and I do not know why", that is not a communication problem. It is a sign you are using a tool you should not be using to make decisions.

The line

If you cannot explain a ranking to the person it affected, do not act on it. Reorder it yourself, or read the pile. A decision you cannot explain does not become defensible by being fast.