Decision Criteria Weighting: When Scores Help and Mislead
Use weighted decision criteria responsibly with thresholds, evidence quality, sensitivity tests and visible trade-offs.
Published:
Weights help when criteria are distinct and evidence is consistent. They mislead when mandatory thresholds, weak evidence or compensating trade-offs disappear inside one total.
Score only after thresholding
A transparent sequence matters more than mathematical sophistication.
- 01
Set gates
Remove options that fail non-negotiable constraints.
- 02
Define anchors
Describe observable evidence for each score.
- 03
Weight early
Agree importance before vendor responses create hindsight bias.
- 04
Test sensitivity
Vary reasonable weights and inspect whether the winner changes.
The high score that still fails
An option scores highly but misses a mandatory data-residency condition. Unrelated strengths cannot compensate unless an authorised exception changes the constraint.
What this method cannot guarantee
- Evidence and operating conditions can change; revisit the record when a material input changes.
- This method structures evidence and judgement; accountable people still make and own the final decision.