Naturalistic Decision Making
Also known as: NDM
Klein, Zsambok, and others' research programme studying how people actually make decisions in real-world high-stakes settings rather than laboratory conditions.
Naturalistic Decision Making (NDM) is the research programme studying how people actually make decisions in real-world high-stakes settings (firefighting, military command, medical emergencies, aviation, nuclear-plant operations) rather than in laboratory conditions with artificial choices and unlimited time. The programme was named and consolidated at the 1989 Dayton conference and the resulting volume Decision Making in Action: Models and Methods (Klein, Orasanu, Calderwood, and Zsambok 1993). NDM contrasts methodologically and conceptually with the Heuristics and Biases programme (Tversky and Kahneman): where Heuristics and Biases studied how laboratory subjects fail at normative rationality, NDM studied how experts succeed at consequential decisions using non-normative methods. Foundational NDM frameworks include Klein's Recognition-Primed Decision Making (situation recognition with mental simulation), Hutchins's distributed cognition, Endsley's situation awareness, Orasanu's team-decision research, and Cohen-Freeman recognition-meta-cognition framework. The 2009 Kahneman-Klein paper 'Conditions for Intuitive Expertise' represented partial reconciliation.
Core components
- Real-world high-stakes settings as research environment (fire scenes, military command posts, hospital emergency departments, aviation cockpits, nuclear plants, corporate C-suites)
- Cognitive task analysis methodology: structured interviews, concept maps, critical-decision-method protocols
- Time pressure, ill-structured problems, dynamic conditions, shifting and competing goals, multiple players, organizational constraints as defining contextual features
- Multiple framework contributions: Recognition-Primed Decision Making (Klein), distributed cognition (Hutchins), situation awareness (Endsley), team decision-making (Orasanu), recognition-meta-cognition (Cohen and Freeman)
- Critical Decision Method: structured interview protocol for eliciting expert decision-making
- Macrocognition framework: synthesis of NDM concepts emphasizing real-world cognitive functions including sensemaking, problem detection, and adaptation
- Methodological contrast with laboratory decision research: NDM studies experts
- Heuristics and Biases studied non-experts in artificial settings
Primary use case
Research framework for expert decision-making across high-stakes domains (military, aviation, healthcare, emergency response, nuclear operations, finance, intelligence analysis); training-design framework for developing decision-making expertise (cognitive task analysis informing training scenarios, debriefing structures, mentor-trainee approaches); human-factors and ergonomics applications: interface design, decision-support systems, alarm-fatigue mitigation; intelligence analysis and counterterrorism applications (Klein's substantial work with the U.S. military and intelligence community); academic reference in cognitive psychology, human factors, and decision-research literatures.
Common criticisms
- NDM has generated substantial scholarly engagement but faces methodological challenges that have been ongoing — the cognitive-task-analysis methodology produces rich descriptive frameworks but limited statistical generalization, and the small-N case-study foundation has been challenged by quantitative-decision-research advocates as insufficient for generalizable causal claims about expert cognition
- the Klein-Kahneman debate during the 1990s and 2000s about the epistemic status of expert intuition produced extensive scholarly discussion, with the 2009 Kahneman-Klein paper 'Conditions for Intuitive Expertise' providing partial reconciliation: intuition can be trusted in environments with valid feedback (high regularity, prompt clear feedback — supporting NDM claims) but not in low-validity environments (chaotic, noisy, delayed feedback — supporting Heuristics and Biases concerns)
- the framework's emphasis on expert success can underweight the substantial documented failures of expert decision-making in domains (intelligence, finance, medicine) where cognitive biases produce systematic errors even among experienced professionals
- integration with normative decision theory and behavioral economics has been theoretically uneven
- the research programme's heavy military and emergency-services empirical base has produced framework features that may not generalize to slower, less time-pressured decision contexts
- cross-cultural applicability has been limited
- the emphasis on individual expert decision-makers underweights team and organizational decision-making considerations addressed only partially through Orasanu's extensions
- commercial-consulting context (Klein Associates, Decision-Making Solutions) raises ordinary concerns about institutional incentives shaping framework promotion
- recent algorithmic-decision-support and AI-augmented decision-making developments raise unanswered questions about how NDM frameworks integrate with computational decision aids.
Lineage
- Parent of
- Recognition-Primed Decision Making
- Siblings
- Heuristics and Biases Program