Landauer's principle

Landauer's principle is a physical principle pertaining to the lower theoretical limit of energy consumption of computation. It holds that "any logically irreversible manipulation of information, such as the erasure of a bit or the merging of two computation paths, must be accompanied by a corresponding entropy increase in non-information-bearing degrees of freedom of the information-processing apparatus or its environment".[1]

Another way of phrasing Landauer's principle is that if an observer loses information about a physical system, heat is generated and the observer loses the ability to extract useful work from that system.

A so-called logically reversible computation, in which no information is erased, may in principle be carried out without releasing any heat. This has led to considerable interest in the study of reversible computing. Indeed, without reversible computing, increases in the number of computations per joule of energy dissipated must eventually come to a halt. If Koomey's law continues to hold, the limit implied by Landauer's principle would be reached around the year 2080.

At 20 °C (room temperature, or 293.15 K), the Landauer limit represents an energy of approximately 0.0175 eV, or 2.805 zJ. Theoretically, room-temperature computer memory operating at the Landauer limit could be changed at a rate of one billion bits per second (1 Gbit/s) with energy being converted to heat in the memory media at the rate of only 2.805 trillionths of a watt (that is, at a rate of only 2.805 pJ/s). Modern computers use millions of times as much energy per second.[2][3]

History

Rolf Landauer first proposed the principle in 1961 while working at IBM.[4] He justified and stated important limits to an earlier conjecture by John von Neumann. For this reason, it is sometimes referred to as being simply the Landauer bound or Landauer limit.

In 2008 and 2009, researchers showed that Landauer's principle can be derived from the second law of thermodynamics and the entropy change associated with information gain, developing the thermodynamics of quantum and classical feedback-controlled systems.[5][6]

In 2011, the principle was generalized to show that while information erasure requires an increase in entropy, this increase could theoretically occur at no energy cost.[7] Instead, the cost can be taken in another conserved quantity, such as angular momentum.

In a 2012 article published in Nature, a team of physicists from the École normale supérieure de Lyon, University of Augsburg and the University of Kaiserslautern described that for the first time they have measured the tiny amount of heat released when an individual bit of data is erased.[8]

In 2014, physical experiments tested Landauer's principle and confirmed its predictions.[9]

In 2016, researchers used a laser probe to measure the amount of energy dissipation that resulted when a nanomagnetic bit flipped from off to on. Flipping the bit required 26 millielectronvolts (4.2 zeptojoules).[10]

A 2018 article published in Nature Physics features a Landauer erasure performed at cryogenic temperatures (T = 1 K) on an array of high-spin (S = 10) quantum molecular magnets. The array is made to act as a spin register where each nanomagnet encodes a single bit of information.[11] The experiment has laid the foundations for the extension of the validity of the Landauer principle to the quantum realm. Owing to the fast dynamics and low "inertia" of the single spins used in the experiment, the researchers also showed how an erasure operation can be carried out at the lowest possible thermodynamic cost—that imposed by the Landauer principle—and at a high speed.[11]

Rationale

Landauer's principle can be understood to be a simple logical consequence of the second law of thermodynamics, which states that the entropy of an isolated system cannot decrease—together with the definition of thermodynamic temperature. For, if the number of possible logical states of a computation were to decrease as the computation proceeded forward (logical irreversibility), this would constitute a forbidden decrease of entropy, unless the number of possible physical states corresponding to each logical state were to simultaneously increase by at least a compensating amount, so that the total number of possible physical states was no smaller than it was originally (i.e. total entropy has not decreased).

Yet, an increase in the number of physical states corresponding to each logical state means that, for an observer who is keeping track of the physical states of the system but not the logical states, the number of possible physical states has increased; in other words, entropy has increased from the point of view of this observer.

The maximum entropy of a bounded physical system is finite. (If the holographic principle is correct, then physical systems with finite surface area have a finite maximum entropy; but regardless of the truth of the holographic principle, quantum field theory dictates that the entropy of systems with finite radius and energy is finite due to the Bekenstein bound.) To avoid reaching this maximum over the course of an extended computation, entropy must eventually be expelled to an outside environment.

Equation

Landauer's principle is based on the more general equation of Leon Brillouin (Brillouin 1956)[12] estimating the energy of one bit of information as the minimum energy of a particle (e.g., photon) that has to overcome the energy of thermal noise to carry the information (formula below). The principle asserts that there is a minimum possible amount of energy required to erase one bit of information, known as the Landauer limit:

${\displaystyle E=k_{\text{B}}T\ln 2,}$

where ${\displaystyle k_{\text{B}}}$ is the Boltzmann constant (approximately 1.38×10−23 J/K), ${\displaystyle T}$ is the temperature of the heat sink in kelvins, and ${\displaystyle \ln 2}$ is the natural logarithm of 2 (approximately 0.69315). After setting ${\displaystyle T}$ equal to room temperature 20 °C (293.15 K), we can get the Landauer limit of 0.0175 eV (2.805 zJ) per bit erased.

The equation can be deduced from Boltzmann's entropy formula (${\displaystyle S=k_{\text{B}}\ln W}$), considering that ${\displaystyle W}$ is the number of states of the system, which in the case of a bit is 2, and the entropy ${\displaystyle S}$ is defined as ${\displaystyle E/T}$. So the operation of erasing a single bit increases the entropy of a value of at least ${\displaystyle k_{\text{B}}\ln 2}$, emitting in the environment a quantity of energy equal or greater than ${\displaystyle k_{\text{B}}T\ln 2}$.

Challenges

The principle is widely accepted as physical law, but in recent years it has been challenged for using circular reasoning and faulty assumptions, notably in Earman and Norton (1998), and subsequently in Shenker (2000)[13] and Norton (2004,[14] 2011[15]), and defended by Bennett (2003),[1] Ladyman et al. (2007),[16] and by Jordan and Manikandan (2019).[17] Other researchers have shown that Landauer's principle is a consequence of the second law of Thermodynamics and the entropy change associated with information gain.[5][6]

On the other hand, recent advances in non-equilibrium statistical physics have established that there is no a priori relationship between logical and thermodynamic reversibility.[18] It is possible that a physical process is logically reversible but thermodynamically irreversible. It is also possible that a physical process is logically irreversible but thermodynamically reversible. At best, the benefits of implementing a computation with a logically reversible system are nuanced.[19]

In 2016, researchers at the University of Perugia claimed to have demonstrated a violation of Landauer’s principle.[20] However, according to Laszlo Kish (2016),[21] their results are invalid because they "neglect the dominant source of energy dissipation, namely, the charging energy of the capacitance of the input electrode".

References

1. ^ a b Charles H. Bennett (2003), "Notes on Landauer's principle, Reversible Computation and Maxwell's Demon" (PDF), Studies in History and Philosophy of Modern Physics, 34 (3): 501–510, arXiv:physics/0210005, Bibcode:2003SHPMP..34..501B, doi:10.1016/S1355-2198(03)00039-X, S2CID 9648186, retrieved 2015-02-18.
2. ^ Thomas J. Thompson. "Nanomagnet memories approach low-power limit". bloomfield knoble. Archived from the original on December 19, 2014. Retrieved May 5, 2013.
3. ^ Samuel K. Moore (14 March 2012). "Landauer Limit Demonstrated". IEEE Spectrum. Retrieved May 5, 2013.
4. ^ Rolf Landauer (1961), "Irreversibility and heat generation in the computing process" (PDF), IBM Journal of Research and Development, 5 (3): 183–191, doi:10.1147/rd.53.0183, retrieved 2015-02-18.
5. ^ a b Sagawa, Takahiro; Ueda, Masahito (2008-02-26). "Second Law of Thermodynamics with Discrete Quantum Feedback Control". Physical Review Letters. 100 (8): 080403. arXiv:0710.0956. Bibcode:2008PhRvL.100h0403S. doi:10.1103/PhysRevLett.100.080403. PMID 18352605. S2CID 41799543.
6. ^ a b Cao, F. J.; Feito, M. (2009-04-10). "Thermodynamics of feedback controlled systems". Physical Review E. 79 (4): 041118. arXiv:0805.4824. Bibcode:2009PhRvE..79d1118C. doi:10.1103/PhysRevE.79.041118. PMID 19518184. S2CID 30188109.
7. ^ Joan Vaccaro; Stephen Barnett (June 8, 2011), "Information Erasure Without an Energy Cost", Proc. R. Soc. A, 467 (2130): 1770–1778, arXiv:1004.5330, Bibcode:2011RSPSA.467.1770V, doi:10.1098/rspa.2010.0577, S2CID 11768197.
8. ^ Antoine Bérut; Artak Arakelyan; Artyom Petrosyan; Sergio Ciliberto; Raoul Dillenschneider; Eric Lutz (8 March 2012), "Experimental verification of Landauer's principle linking information and thermodynamics" (PDF), Nature, 483 (7388): 187–190, arXiv:1503.06537, Bibcode:2012Natur.483..187B, doi:10.1038/nature10872, PMID 22398556, S2CID 9415026.
9. ^ Yonggun Jun; Momčilo Gavrilov; John Bechhoefer (4 November 2014), "High-Precision Test of Landauer's Principle in a Feedback Trap", Physical Review Letters, 113 (19): 190601, arXiv:1408.5089, Bibcode:2014PhRvL.113s0601J, doi:10.1103/PhysRevLett.113.190601, PMID 25415891, S2CID 10164946.
10. ^ Hong, Jeongmin; Lambson, Brian; Dhuey, Scott; Bokor, Jeffrey (2016-03-01). "Experimental test of Landauer's principle in single-bit operations on nanomagnetic memory bits". Science Advances. 2 (3): e1501492. Bibcode:2016SciA....2E1492H. doi:10.1126/sciadv.1501492. ISSN 2375-2548. PMC 4795654. PMID 26998519..
11. ^ a b Rocco Gaudenzi; Enrique Burzuri; Satoru Maegawa; Herre van der Zant; Fernando Luis (19 March 2018), "Quantum Landauer erasure with a molecular nanomagnet", Nature Physics, 14 (6): 565–568, Bibcode:2018NatPh..14..565G, doi:10.1038/s41567-018-0070-7, hdl:10261/181265, S2CID 125321195.
12. ^ Brillouin, Leon (1956). Science and Information Theory. Academic Press, New York
13. ^ Logic and Entropy. Critique by Orly Shenker (2000).
14. ^ Eaters of the Lotus. Critique by John Norton (2004).
15. ^ Waiting for Landauer. Response by Norton (2011).
16. ^ The Connection between Logical and Thermodynamic Irreversibility. Defense by Ladyman et al. (2007).
17. ^ Some Like It Hot. Letter to the Editor in reply to Norton's article by A. Jordan and S. Manikandan (2019).
18. ^ Takahiro Sagawa (2014), "Thermodynamic and logical reversibilities revisited", Journal of Statistical Mechanics: Theory and Experiment, 2014 (3): 03025, arXiv:1311.1886, Bibcode:2014JSMTE..03..025S, doi:10.1088/1742-5468/2014/03/P03025, S2CID 119247579.
19. ^ David H. Wolpert (2019), "Stochastic thermodynamics of computation", Journal of Physics A: Mathematical and Theoretical, 52 (19): 193001, arXiv:1905.05669, Bibcode:2019JPhA...52s3001W, doi:10.1088/1751-8121/ab0850, S2CID 126715753.
20. ^
21. ^ Laszlo Bela Kish (2016). "Comments on 'Sub-kBT Micro-Electromechanical Irreversible Logic Gate'". Fluctuation and Noise Letters. 14 (4): 1620001–1620194. arXiv:1606.09493. Bibcode:2016FNL....1520001K. doi:10.1142/S0219477516200017. S2CID 12110986. Retrieved 2020-03-08.