Information meets thermodynamics

Context

A demon walks into physics. In an 1867 letter to Tait, Maxwell imagined a "very observant and neat-fingered" being operating a frictionless door between two gas chambers, letting fast molecules pass one way and slow ones the other — sorting heat from cold with no work, wrecking the second law of thermodynamics using nothing but knowledge of molecular positions. It was a puzzle designed to show the second law is statistical, and it refused to die: the demon haunted physics for 115 years because nobody could say exactly what was wrong with it.

The exorcism took a century. Szilard sharpened it in 1929 to a single-molecule engine and located the cost in the demon's measurement — a wrong guess that stood for decades. The real answer came from IBM. Rolf Landauer proved in 1961 that logically irreversible operations — erasing a bit — carry a minimum thermodynamic price: at least kT ln 2 of dissipated heat per bit. "Information is physical," he insisted, and physicists slowly stopped smiling at the phrase. Then Charles Bennett closed the loop in 1982: measurement can be done reversibly, for free — but the demon's memory fills, and to keep running it must eventually erase, paying back at least everything it gained. The second law survives precisely because information storage is a physical act. Bennett had already shown (1973) that computation itself can in principle be logically reversible and dissipation-free — an ideal limit; real machines still pay — with Fredkin and Toffoli's reversible gates making it concrete.

Why this is the hinge. Boltzmann's statistical mechanics was already a theory of information — entropy as missing information about microstates — a century before anyone phrased it that way. This unit is where that becomes explicit, where the Information path first touches the physical world, and where the question this curriculum keeps circling gets its sharpest form: bits are not free-floating abstractions; every one of them is written on matter and paid for in heat.

How to read it

Anchor. Paul Davies, The Demon in the Machine, chapters 1–4. Davies is strongest exactly on this thermodynamics/information/biology intersection. ~15 hours.

Companion. A short pass on Landauer's principle — the Wikipedia article plus Bérut et al. 2012 (Nature), the experiment that verified it. ~2 hours. This is where you watch information become energy in a real lab.

Companion (optional). Bennett's classic expositions of Maxwell's demon for the formal treatment; otherwise the summary suffices.

The bridge to hold: Boltzmann entropy and Shannon entropy are the same quantity in different languages — and Bekenstein's black-hole entropy is the next landmark on the same road.