Landauer's principle is a physical principle pertaining to the lower theoretical limit of energy consumption of computation. It holds that "any logically irreversible manipulation of information, such as the erasure of a bit or the merging of two computation paths, must be accompanied by a corresponding entropy increase in non-information-bearing degrees of freedom of the information-processing apparatus or its environment".
Another way of phrasing Landauer's principle is that if an observer loses information about a physical system, the observer loses the ability to extract work from that system.
A so-called logically-reversible computation, in which no information is erased, may in principle be carried out without releasing any heat. This has led to considerable interest in the study of reversible computing. Indeed, without reversible computing, increases in the number of computations-per-joule-of-energy-dissipated must come to a halt by about 2050: because the limit implied by Landauer's principle will be reached by then, according to Koomey's law.
At 20 °C (room temperature, or 293.15 K), the Landauer limit represents an energy of approximately 0.0172 eV, or 2.75 zJ. Theoretically, room‑temperature computer memory operating at the Landauer limit could be changed at a rate of one billion bits per second with energy being converted to heat in the memory media at the rate of only 2.85 trillionths of a watt (that is, at a rate of only 2.85 pJ/s). Modern computers use millions of times as much energy per second.
Rolf Landauer first proposed the principle in 1961 while working at IBM. He rigorously justified and stated important limits to an earlier conjecture by John von Neumann. For this reason, it is sometimes referred to as being simply the Landauer bound or Landauer limit.
In 2011, the principle was generalized to show that while information erasure requires an increase in entropy, that increase could theoretically occur at no energy cost. Instead, the cost can be taken in another conserved quantity, such as angular momentum.
In a 2012 article published in Nature, a team of physicists from the École normale supérieure de Lyon, University of Augsburg and the University of Kaiserslautern described that for the first time they have measured the tiny amount of heat released when an individual bit of data is erased.
In 2014, physical experiments tested Landauer's principle and confirmed its predictions.
In 2016, researchers used a laser probe to measure the amount of energy dissipation that resulted when a nanomagnetic bit flipped from off to on. Flipping the bit required 15 millielectron volts (3 zeptojoules).
Landauer's principle can be understood to be a simple logical consequence of the second law of thermodynamics—which states that the entropy of an isolated system cannot decrease—together with the definition of thermodynamic temperature. For, if the number of possible logical states of a computation were to decrease as the computation proceeded forward (logical irreversibility), this would constitute a forbidden decrease of entropy, unless the number of possible physical states corresponding to each logical state were to simultaneously increase by at least a compensating amount, so that the total number of possible physical states was no smaller than it was originally (i.e. total entropy has not decreased).
Yet, an increase in the number of physical states corresponding to each logical state means that, for an observer who is keeping track of the logical state of the system but not the physical state (for example an "observer" consisting of the computer itself), the number of possible physical states has increased; in other words, entropy has increased from the point of view of this observer.
The maximum entropy of a bounded physical system is finite. (If the holographic principle is correct, then physical systems with finite surface area have a finite maximum entropy; but regardless of the truth of the holographic principle, quantum field theory dictates that the entropy of systems with finite radius and energy is finite due to the Bekenstein bound.) To avoid reaching this maximum over the course of an extended computation, entropy must eventually be expelled to an outside environment.
Landauer's principle asserts that there is a minimum possible amount of energy required to erase one bit of information, known as the Landauer limit:
- kT ln 2,
For an environment at temperature T, energy E = ST must be emitted into that environment if the amount of added entropy is S. For a computational operation in which 1 bit of logical information is lost, the amount of entropy generated is at least k ln 2, and so, the energy that must eventually be emitted to the environment is E ≥ kT ln 2.
The principle is widely accepted as physical law, but in recent years it has been challenged for using circular reasoning and faulty assumptions, notably in Earman and Norton (1998), and subsequently in Shenker (2000) and Norton (2004, 2011), and defended by Bennett (2003) and Ladyman et al. (2007).
- Margolus–Levitin theorem
- Bremermann's limit
- Bekenstein bound
- Kolmogorov complexity
- Entropy in thermodynamics and information theory
- Information theory
- Jarzynski equality
- Limits to computation
- Extended mind thesis
- Charles H. Bennett (2003), "Notes on Landauer's principle, Reversible Computation and Maxwell's Demon" (PDF), Studies in History and Philosophy of Modern Physics, 34 (3): 501–510, arXiv:physics/0210005, Bibcode:2003SHPMP..34..501B, doi:10.1016/S1355-2198(03)00039-X, retrieved 2015-02-18
- "Tikalon Blog by Dev Gualtieri". Tikalon.com. Retrieved May 5, 2013.
- "Nanomagnet memories approach low-power limit | bloomfield knoble". Bloomweb.com. Retrieved May 5, 2013.
- "Landauer Limit Demonstrated - IEEE Spectrum". Spectrum.ieee.org. Retrieved May 5, 2013.
- Rolf Landauer (1961), "Irreversibility and heat generation in the computing process" (PDF), IBM Journal of Research and Development, 5 (3): 183–191, doi:10.1147/rd.53.0183, retrieved 2015-02-18
- Joan Vaccaro; Stephen Barnett (June 8, 2011), "Information Erasure Without an Energy Cost" (PDF), Proc. R. Soc. A, 467 (2130): 1770–1778, arXiv:1004.5330, Bibcode:2011RSPSA.467.1770V, doi:10.1098/rspa.2010.0577
- Antoine Bérut; Artak Arakelyan; Artyom Petrosyan; Sergio Ciliberto; Raoul Dillenschneider; Eric Lutz (8 March 2012), "Experimental verification of Landauer's principle linking information and thermodynamics" (PDF), Nature, 483 (7388): 187–190, arXiv:1503.06537, Bibcode:2012Natur.483..187B, doi:10.1038/nature10872, PMID 22398556
- Yonggun Jun; Momčilo Gavrilov; John Bechhoefer (4 November 2014), "High-Precision Test of Landauer's Principle in a Feedback Trap", Physical Review Letters, 113 (19): 190601, arXiv:1408.5089, Bibcode:2014PhRvL.113s0601J, doi:10.1103/PhysRevLett.113.190601
- Hong, Jeongmin; Lambson, Brian; Dhuey, Scott; Bokor, Jeffrey (2016-03-01). "Experimental test of Landauer's principle in single-bit operations on nanomagnetic memory bits". Science Advances. 2 (3): e1501492. Bibcode:2016SciA....2E1492H. doi:10.1126/sciadv.1501492. ISSN 2375-2548. PMC 4795654. PMID 26998519.
- Logic and Entropy Critique by Orly Shenker (2000)
- Eaters of the Lotus Critique by John Norton (2004)
- Waiting for Landauer Response by Norton (2011)
- The Connection between Logical and Thermodynamic Irreversibility Defense by Ladyman et al. (2007)
- Prokopenko, Mikhail; Lizier, Joseph T. (2014), "Transfer entropy and transient limits of computation", Scientific Reports, 4, Bibcode:2014NatSR...4E5394P, doi:10.1038/srep05394
- Public debate on the validity of Landauer's principle (conference Hot Topics in Physical Informatics, November 12, 2013)
- Introductory article on Landauer's principle and reversible computing
- Maroney, O.J.E. "Information Processing and Thermodynamic Entropy" The Stanford Encyclopedia of Philosophy.
- Eurekalert.org: "Magnetic memory and logic could achieve ultimate energy efficiency", July 1, 2011