When we judge decisions by their results, not their reasoning
Imagine you're evaluating several professionals who made important decisions. Your job is to rate how good their decision-making was based on the information they had at the time.
The Question: Do you judge decisions based on the quality of reasoning, or are you unconsciously influenced by how things turned out?
You'll read about 6 decision-makers and rate how competent their choices were. Try to evaluate the quality of the decision itself, not what happened afterward.
You've just experienced outcome bias—the tendency to evaluate decisions based on their eventual outcomes rather than the quality of the decision-making process. In each pair of scenarios, the decision-maker had identical information and made the same choice, but you likely rated them differently based on what happened afterward.
Psychologists Jonathan Baron and John Hershey at the University of Pennsylvania conducted the foundational research on outcome bias. In their experiments, participants read about decisions with either positive or negative outcomes.
Key Finding: When a physician decided to proceed with a surgery and the patient survived, participants rated the decision as significantly better than when the exact same decision led to the patient's death—even though the decision itself was identical.
— Baron, J., & Hershey, J. C. (1988). Outcome bias in decision evaluation. Journal of Personality and Social Psychology, 54(4), 569-579.
Their studies showed this effect across multiple domains:
Professional poker players have a term for outcome bias: "resulting." It means judging a decision based on its result rather than its expected value.
Imagine going all-in with Ace-King suited against 7-2 offsuit (the worst hand in poker). You have about an 87% chance to win. But if your opponent hits a miracle 7-7-2 on the board, did you make a bad decision?
Duke, author of Thinking in Bets, explains that "resulting" leads to terrible long-term decisions. Winners who made poor choices think their strategy was sound, while losers who made excellent choices doubt their reasoning.
Hindsight Bias Connection: Once we know the outcome, it seems more predictable than it actually was. We think "they should have known" what would happen, even when the outcome depended on factors beyond anyone's control.
Several cognitive mechanisms contribute to outcome bias:
1. Outcome availability: The final result is vivid and concrete, while the probabilistic reasoning that went into the decision is abstract and harder to evaluate.
2. Just-world thinking: We want to believe that good decisions lead to good outcomes and bad decisions lead to bad outcomes. When outcomes are random, this belief is threatened.
3. Attribution shortcuts: It takes mental effort to separately evaluate the decision process from its outcome. Our brains take the shortcut of using outcomes as evidence of decision quality.
Outcome bias affects critical judgments:
Medical malpractice: Juries are more likely to find doctors negligent when patients have bad outcomes, even when the doctor followed best practices. A study found that "bad outcomes doubled the odds of a negligence finding" compared to identical care with good outcomes.
Business evaluation: CEOs who make risky decisions that happen to pay off are praised as visionaries. Those who make the same calculated gamble but lose are criticized as reckless—even when both faced identical odds.
Hiring and promotion: Managers who made lucky decisions get promoted, while those with better judgment but unlucky results get passed over.
The antidote is process-focused evaluation:
Key Insight: Good decisions can have bad outcomes. Bad decisions can have good outcomes. The quality of a decision depends on the process, not the result. A world-class doctor whose patient dies from unforeseeable complications made no worse a decision than one whose patient miraculously recovers.
The concept of outcome bias was formally introduced by Jonathan Baron and John Hershey in their 1988 paper "Outcome bias in decision evaluation." Their work demonstrated that outcome information fundamentally changes how people evaluate decisions, even when told to focus only on the decision process.
Baron & Hershey (1988): In five experiments, participants consistently rated identical decisions differently based on outcomes. Even when explicitly instructed to ignore outcomes, the bias persisted, though it was reduced.
Gino, Moore & Bazerman (2009): Showed that outcome bias affects ethical judgments—the same ethically questionable decision was judged more harshly when it led to bad outcomes.
Brownback & Kuhn (2019): Demonstrated that even sports experts exhibit strong outcome bias when evaluating coaching decisions, despite their expertise in probabilistic thinking.
Outcome bias is closely related to:
The bias reveals a deep tension in human cognition: we live in a probabilistic world, but our minds are wired to see causality and intention in outcomes.