Skip to content
Field Atlas

Atlas / Physics / The Entropy Thread

Field · Emerged 1867 – 1999

Non-Equilibrium Physics

What laws govern systems that are driven, flowing and never at rest, and what does information cost?

5 chapters4 min read6 turning points1 open problem

Branched from
Statistical Mechanics
Branched into
Not yet surveyed past here
Figures
James Clerk Maxwell, William Thomson (Lord Kelvin), Leo Szilard, Rolf Landauer, Charles Bennett, Lars Onsager, Boris Belousov, Ilya Prigogine, Denis Evans, Christopher Jarzynski, Gavin Crooks, Antoine Bérut, Eric Lutz

In brief

Thermodynamics and statistical mechanics describe matter in equilibrium, settled and unchanging. Most of the world is not like that. Rivers flow, weather churns, computers switch, and every living cell is driven by a constant flow of energy. Non-equilibrium physics studies such systems, where heat and matter are always moving through.

It has no general theory comparable to Gibbs's for equilibrium, but it has found some exact laws. Onsager's reciprocal relations connect different flows near equilibrium. The fluctuation theorems of the 1990s hold arbitrarily far from equilibrium. Along the way, a puzzle Maxwell posed in 1867, a demon that seems to break the second law, was resolved by showing that information is physical: erasing one bit has a minimum cost in energy.

Key ideas

Maxwell's demonEnters 1867

A thought experiment: a being that sorts fast and slow molecules could make one side of a box hot and the other cold without doing work, apparently violating the second law.

Landauer's principleEnters 1929 – 1982

Erasing one bit of information releases at least kBTln⁡2k_B T \ln 2 of heat. The demon is defeated because it must eventually erase its memory.

Onsager reciprocityEnters 1931

Near equilibrium, the effect of one kind of push on another kind of flow equals the reverse effect. A temperature difference driving an electric current is matched by a voltage driving heat.

Fluctuation theoremEnters 1993 – 1999

In small systems, entropy can briefly decrease. Fluctuation theorems give the exact odds, and show that decreases become exponentially rarer as they get larger.

Dissipative structureEnters 1951 – 1977

An ordered pattern maintained by a constant flow of energy, such as convection cells, chemical waves or a living organism.

Draws on other domains

Chapter I

The Demon

In 1867, in a letter to his friend Tait, James Clerk Maxwell imagined a tiny being guarding a trapdoor between two chambers of gas. It lets fast molecules pass one way and slow ones the other. Without any work being done, one chamber heats up and the other cools, in apparent violation of the second law. Maxwell's point was that the second law is statistical: it holds because we cannot handle molecules one by one. William Thomson called the being a demon, and for a century physicists argued about what stops it.

In 1929 Leo Szilard reduced the problem to a box containing a single molecule and argued that the demon's knowledge must carry a cost in entropy. The full answer came from computing. Rolf Landauer at IBM argued in 1961 that the unavoidable cost lies in erasing information, and Charles Bennett showed in 1982 that the demon can measure for free but must eventually clear its memory, and that erasure pays back the entropy it saved. Information is physical.

Chapter II

Flows Near Equilibrium

Most real processes involve flows: heat through a wall, current through a wire, salt through a membrane. In 1931 Lars Onsager found a general law for such flows near equilibrium. When a temperature difference drives an electric current, as in a thermocouple, the reverse effect, a voltage driving heat, is governed by the same coefficient. His reciprocal relations follow from the reversibility of molecular motion, and they are the foundation of non-equilibrium thermodynamics.

Chapter III

Order From Flow

Far from equilibrium, systems can organise themselves. In 1951 Boris Belousov found a chemical mixture that oscillated between colours for hours. Journals rejected his paper because chemical reactions were supposed to run steadily towards equilibrium. Anatol Zhabotinsky developed it in the 1960s, and it produces spirals and travelling waves. Ilya Prigogine argued that such "dissipative structures", ordered patterns sustained by a flow of energy, are common. Convection cells, chemical waves and living organisms all maintain their order by exporting entropy.

In the 1990s exact laws were found that hold arbitrarily far from equilibrium. Denis Evans and colleagues found how often small systems briefly run "backwards", with entropy decreasing. Christopher Jarzynski and Gavin Crooks found equalities that extract equilibrium quantities from violently irreversible processes. Biophysicists now use them on single molecules.

Chapter IV

A Closer Look: The Price of Forgetting One Bit

Landauer's limit for erasing one bit at temperature TT is kBTln⁡2k_B T \ln 2. At room temperature, 300 K:

kBTln⁡2=1.38×10−23×300×0.693≈2.9×10−21 J,k_B T \ln 2 = 1.38 \times 10^{-23} \times 300 \times 0.693 \approx 2.9 \times 10^{-21} \text{ J},

or about 0.018 electronvolts. To see where it comes from, picture Szilard's engine: one molecule in a box, with a partition in the middle. A bit of memory records which half the molecule is in. Erasing the bit means resetting it to a standard value, say "left", whatever it was. The only way to do that without looking is to push the molecule into the left half, compressing its one-molecule gas to half its volume. The work needed is the heat released, kBTln⁡2k_B T \ln 2, exactly the entropy change kBln⁡2k_B \ln 2 times the temperature, the same factor of ln⁡2\ln 2 that appears when a gas doubles its volume.

Erasing a gigabyte, 8×1098 \times 10^9 bits, therefore costs at least

8×109×2.9×10−21≈2.3×10−11 J,8 \times 10^9 \times 2.9 \times 10^{-21} \approx 2.3 \times 10^{-11} \text{ J} ,

a trivially small amount. Real chips dissipate thousands of times more per operation, because their switches are far from ideal. Landauer's limit is not what makes phones warm today. But it is a floor that no technology can go below, unless computation is made reversible, never erasing anything.

In 2012 Antoine Bérut, Eric Lutz and colleagues stored a bit as the position of a glass bead in a laser trap with two wells, then erased it, slowly. The average heat released approached kBTln⁡2k_B T \ln 2 from above, as the erasure was made slower. The demon's century-old puzzle had become a bench-top measurement.

Chapter V

Life and Other Driven Systems

The central challenge is still open: no general principle is known that says which states a system far from equilibrium prefers, as the Boltzmann factor does in statistical mechanics. The need for one is most pressing for living matter. Cells are driven chemical machines, running molecular motors, copying DNA with error correction and sensing their environment, all at energetic costs that non-equilibrium physics can now begin to measure. The arrow of time that thermodynamics left unexplained is, in the end, what powers them all.

Applications

Where it is used

  • Molecular biology↗ Biology · Molecular Biology

    Measuring energy by pulling on RNA

    Liphardt and colleagues unfolded single RNA molecules with optical tweezers, too fast for equilibrium, and used Jarzynski's equality to recover the equilibrium folding energy from the irreversible pulls. Such methods now measure the energetics of molecular motors and protein folding.

    › Sources (1)
    • Liphardt, J., Dumont, S., Smith, S. B., Tinoco, I. & Bustamante, C. (2002). Equilibrium information from nonequilibrium measurements in an experimental test of Jarzynski's equality. Science 296(5574): 1832–1835.
  • Computing

    The ultimate energy cost of computation

    Landauer's principle sets the minimum energy for irreversible computing. Today's chips dissipate thousands of times more per operation, so the limit is not yet binding, but it motivates reversible and adiabatic computing, which avoid erasing information.

    › Sources (1)
    • Bennett, C. H. (1982). The thermodynamics of computation — a review. International Journal of Theoretical Physics 21(12): 905–940.
  • Transport

    Traffic jams from nowhere

    Traffic is a driven system of interacting particles. Simple models from non-equilibrium physics show jams forming spontaneously, with no accident or bottleneck, once density passes a threshold, as experiments on circular tracks have confirmed.

    › Sources (1)
    • Nagel, K. & Schreckenberg, M. (1992). A cellular automaton model for freeway traffic. Journal de Physique I 2(12): 2221–2229.

Open problems

Where the map runs out

Open

A general theory far from equilibrium

Open as of 2026; exact results exist only in special cases.

Equilibrium has one universal recipe: weight each state by e−E/kTe^{-E/kT}. Is there anything comparable for systems held far from equilibrium by a constant flow of energy, such as a heated fluid, a sheared material or a living cell? Which of their states are likely, and what principle selects them?

Why it is hard

Far from equilibrium, the likelihood of a state depends on the whole history of flows through the system, not just its energy. Proposed general principles, such as maximum or minimum entropy production, hold only in special cases, and the fluctuation theorems constrain the statistics without determining them.

What resolving it unlocks

A physics of living matter, of climate and of active materials, and a principled account of how order arises in driven systems.

› Sources (1)
  • Seifert, U. (2012). Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12): 126001.

Further reading

  1. von Baeyer, H. C. (1998). Maxwell's Demon: Why Warmth Disperses and Time Passes. Random House.

    A popular history of the demon and the physics of information.

  2. Leff, H. S. & Rex, A. F. (eds.) (2003). Maxwell's Demon 2: Entropy, Classical and Quantum Information, Computing. Institute of Physics Publishing.

    The key papers on the demon, collected with commentary.

  3. Seifert, U. (2012). Stochastic thermodynamics, fluctuation theorems and molecular machines. Reports on Progress in Physics 75(12): 126001.

    A technical review of the modern theory of small driven systems.