Logical Depth

Also known as: Bennett Depth

framework · mathematics · formal-scientific

Charles Bennett's measure of the computational resources required to produce an object from its shortest description, capturing how much 'work' a structured object encodes.

Logical Depth is the formal-scientific complexity measure developed by Charles H. Bennett (IBM Research) in his 1988 paper 'Logical Depth and Physical Complexity' in The Universal Turing Machine: A Half-Century Survey (edited by Rolf Herken). The measure quantifies the complexity of an object as the computational time required to produce the object from its near-minimal program — that is, how computationally expensive it is to derive the object from its compressed description. Where Kolmogorov complexity measures the size of the minimal program (static information content), logical depth measures the running time of that program (the computational history embedded in the object). Bennett argued that logical depth captures the physical-complexity intuition that complex objects (cells, civilizations, books) embody substantial computational history while both random objects (no compression) and trivially-ordered objects (instant production) are shallow. Logical depth is one of three foundational alternatives to Kolmogorov complexity addressing the structured-process intuition, alongside Effective Complexity (Gell-Mann) and Statistical Complexity (Crutchfield-Young).

Originators

Charles H. Bennett (IBM Research, foundational author); Foundational 1988 paper 'Logical Depth and Physical Complexity' in The Universal Turing Machine: A Half-Century Survey (Herken ed.); intellectual antecedents in Kolmogorov complexity (Solomonoff 1960, Kolmogorov 1965, Chaitin 1966), computational-complexity theory, broader thermodynamics-of-computation tradition (Landauer, Bennett's own foundational reversible-computation work 1973); Subsequent development through Bennett's broader thermodynamics-of-computation and quantum-information research, ongoing complexity-measure research high

Year / Decade

1988 (foundational publication); ongoing development through complexity-measure research high

Primary sources

Bennett, C.H. (1988). 'Logical Depth and Physical Complexity', in Herken (ed.) The Universal Turing Machine: A Half-Century Survey, Bennett, C.H. (1990). 'How to Define Complexity in Physics, and Why', in Zurek (ed.) Complexity, Entropy, and the Physics of Information, Lloyd, S. & Pagels, H. (1988). 'Complexity as Thermodynamic Depth', Annals of Physics (related thermodynamic-depth measure), Ay, N., Müller, M. & Szkola, A. (2010). 'Effective Complexity and Its Relation to Logical Depth', IEEE Transactions on Information Theory (formal comparison) high

Core components

Primary use case

Foundational complexity measure addressing the intuition that complex objects embody substantial computational history; applied principally in: complexity-theory foundational research, philosophical-foundational discussions of complexity and emergence, biological-complexity characterization, broader thermodynamics-of-computation research; academic and professional reference in computational complexity, statistical physics, information theory, and broader interdisciplinary complexity literature; complementary to Statistical Complexity (Crutchfield-Young), Effective Complexity (Gell-Mann), and other proposed complexity measures; intellectual foundation for slow-growth-law-based discussions of the origin of complexity in physical and biological systems; modest empirical application due to computational-uncomputability of logical depth in general — research applications use approximations and specific-case analysis rather than direct computation.

Common criticisms

Lineage

Siblings
Statistical Complexity, Effective Complexity, Self-Organized Criticality
Derived from
Information Theory