[Paper Review] Maxwell's demon and the thermodynamics of computation

Jeffrey Bub|ArXiv.org|Mar 5, 2002

Advanced Thermodynamics and Statistical Mechanics8 references4 citations

TL;DR

This paper defends the established view that information acquisition via measurement incurs no fundamental entropy cost, while information erasure—resetting a computer's memory to zero—inevitably dissipates heat into the environment, incurring a minimum entropy cost of $k\log 2$ per bit. The author refutes Earman and Norton's challenge by showing that reversible measurement is possible without entropy cost, but irreversible erasure is thermodynamically unavoidable, preserving the second law of thermodynamics in the context of Maxwell's demon and computation.

ABSTRACT

It is generally accepted, following Landauer and Bennett, that the process of measurement involves no minimum entropy cost, but the erasure of information in resetting the memory register of a computer to zero requires dissipating heat into the environment. This thesis has been challenged recently in a two-part article by Earman and Norton. I review some relevant observations in the thermodynamics of computation and argue that Earman and Norton are mistaken: there is in principle no entropy cost to the acquisition of information, but the destruction of information does involve an irreducible entropy cost.

Motivation & Objective

• To resolve the paradox of Maxwell's demon by clarifying the thermodynamic cost of information processing.
• To challenge Earman and Norton's claim that both measurement and erasure could be entropy-free in a computerized demon.
• To establish that only information erasure, not acquisition, involves an irreducible entropy cost.
• To demonstrate that a computerized demon cannot bypass the second law without violating thermodynamic irreversibility in memory reset.

Proposed method

• Analyzes the thermodynamics of computation through Landauer's and Bennett's principles, focusing on memory register operations.
• Applies statistical mechanics to model a computer's memory as a physical system with discrete states (e.g., spin systems).
• Uses the concept of phase space compression to show that resetting a memory register reduces accessible states, requiring heat dissipation.
• Contrasts reversible measurement (no entropy cost) with logically irreversible erasure (entropy cost of $k\log 2$ per bit).
• Examines Landauer’s thought experiment with an array of spins to illustrate entropy reduction during reset and its environmental heat cost.
• Critiques Earman and Norton’s demon model by showing its reliance on state-specific, non-universal reset operations evades the core thermodynamic constraint.

Experimental results

Research questions

• RQ1 Does the acquisition of information via measurement incur an irreducible entropy cost, as Szilard and Brillouin claimed?
• RQ2 Is the erasure of information in a computer’s memory register thermodynamically unavoidable, as Landauer and Bennett argued?
• RQ3 Can a computerized Maxwell’s demon function as a perpetual motion machine of the second kind if measurement is reversible and erasure is avoided?
• RQ4 Does the demon’s failure to convert heat into work stem from measurement or from memory reset, according to thermodynamic principles?
• RQ5 Can a demon that uses state-specific reset operations evade the entropy cost of erasure, as Earman and Norton suggest?

Key findings

• Measurement, as a copying process, can be performed reversibly and without any entropy cost in principle, contrary to Szilard’s principle.
• Erasing information by resetting a memory register to a definite state (e.g., all ones) reduces the system’s phase space and thus its entropy, requiring heat dissipation into the environment.
• The minimum entropy cost of erasing one bit of information is $k\log 2$, as established by Landauer’s principle, and this cost is unavoidable for any logically irreversible operation.
• A reset operation that is tailored to the initial state (e.g., only resetting from zero to one) can reduce the entropy cost, but only if prior knowledge of the input state is used.
• Earman and Norton’s demon fails to address the core issue because it relies on state-dependent operations that are not general-purpose, thus evading the fundamental thermodynamic constraint.
• The second law of thermodynamics is preserved not by information acquisition, but by the irreversible erasure of information in the memory register, which ensures net entropy increase in the universe.