HOME

TheInfoList



OR:

Landauer's principle is a physical principle pertaining to the lower
theoretical A theory is a rational type of abstract thinking about a phenomenon, or the results of such thinking. The process of contemplative and rational thinking is often associated with such processes as observational study or research. Theories may be ...
limit of
energy consumption Energy consumption is the amount of energy used. Biology In the body, energy consumption is part of energy homeostasis. It derived from food energy. Energy consumption in the body is a product of the basal metabolic rate and the physical activit ...
of
computation Computation is any type of arithmetic or non-arithmetic calculation that follows a well-defined model (e.g., an algorithm). Mechanical or electronic devices (or, historically, people) that perform computations are known as ''computers''. An esp ...
. It holds that "any logically irreversible manipulation of
information Information is an abstract concept that refers to that which has the power to inform. At the most fundamental level information pertains to the interpretation of that which may be sensed. Any natural process that is not completely random, ...
, such as the erasure of a
bit The bit is the most basic unit of information in computing and digital communications. The name is a portmanteau of binary digit. The bit represents a logical state with one of two possible values. These values are most commonly represente ...
or the merging of two
computation Computation is any type of arithmetic or non-arithmetic calculation that follows a well-defined model (e.g., an algorithm). Mechanical or electronic devices (or, historically, people) that perform computations are known as ''computers''. An esp ...
paths, must be accompanied by a corresponding
entropy Entropy is a scientific concept, as well as a measurable physical property, that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodyna ...
increase in non-information-bearing
degrees of freedom Degrees of freedom (often abbreviated df or DOF) refers to the number of independent variables or parameters of a thermodynamic system. In various scientific fields, the word "freedom" is used to describe the limits to which physical movement or ...
of the information-processing apparatus or its environment".. Another way of phrasing Landauer's principle is that if an observer loses information about a
physical system A physical system is a collection of physical objects. In physics, it is a portion of the physical universe chosen for analysis. Everything outside the system is known as the environment. The environment is ignored except for its effects on the ...
, heat is generated and the observer loses the ability to extract useful work from that system. A so-called logically reversible computation, in which no information is erased, may in principle be carried out without releasing any heat. This has led to considerable interest in the study of
reversible computing Reversible computing is any model of computation where the computational process, to some extent, is time-reversible. In a model of computation that uses deterministic transitions from one state of the abstract machine to another, a necessary co ...
. Indeed, without reversible computing, increases in the number of computations per joule of energy dissipated must eventually come to a halt. If
Koomey's law Koomey's law describes a trend in the history of computing hardware: for about a half-century, the number of computations per joule of energy dissipated doubled about every 1.57 years. Professor Jonathan Koomey described the trend in a 2010 pap ...
continues to hold, the limit implied by Landauer's principle would be reached around the year 2080. At 20 ° C (room temperature, or 293.15 K), the Landauer limit represents an energy of approximately 0.0175 eV, or 2.805 zJ. Theoretically, room-temperature computer memory operating at the Landauer limit could be changed at a rate of one billion bits per second (1 Gbit/s) with energy being converted to heat in the memory media at the rate of only 2.805 trillionths of a watt (that is, at a rate of only 2.805 pJ/s). Modern computers use millions of times as much energy per second.


History

Rolf Landauer Rolf William Landauer (February 4, 1927 – April 27, 1999) was a German-American physicist who made important contributions in diverse areas of the thermodynamics of information processing, condensed matter physics, and the conductivity of dis ...
first proposed the principle in 1961 while working at IBM.. He justified and stated important limits to an earlier conjecture by
John von Neumann John von Neumann (; hu, Neumann János Lajos, ; December 28, 1903 – February 8, 1957) was a Hungarian-American mathematician, physicist, computer scientist, engineer and polymath. He was regarded as having perhaps the widest c ...
. For this reason, it is sometimes referred to as being simply the Landauer bound or Landauer limit. In 2008 and 2009, researchers showed that Landauer's principle can be derived from the
second law of thermodynamics The second law of thermodynamics is a physical law based on universal experience concerning heat and energy interconversions. One simple statement of the law is that heat always moves from hotter objects to colder objects (or "downhill"), unle ...
and the entropy change associated with information gain, developing the thermodynamics of quantum and classical feedback-controlled systems. In 2011, the principle was generalized to show that while information erasure requires an increase in entropy, this increase could theoretically occur at no energy cost.. Instead, the cost can be taken in another
conserved quantity In mathematics, a conserved quantity of a dynamical system is a function of the dependent variables, the value of which remains constant along each trajectory of the system. Not all systems have conserved quantities, and conserved quantities are ...
, such as
angular momentum In physics, angular momentum (rarely, moment of momentum or rotational momentum) is the rotational analog of linear momentum. It is an important physical quantity because it is a conserved quantity—the total angular momentum of a closed syst ...
. In a 2012 article published in ''Nature'', a team of physicists from the École normale supérieure de Lyon,
University of Augsburg The University of Augsburg (german: Universität Augsburg) is a university located in the Universitätsviertel section of Augsburg, Germany. It was founded in 1970 and is organized in 8 Faculties. The University of Augsburg is a relatively you ...
and the
University of Kaiserslautern Technical University of Kaiserslautern (German: ''Technische Universität Kaiserslautern'', also known as TU Kaiserslautern or TUK) is a public research university in Kaiserslautern, Germany. There are numerous institutes around the university, ...
described that for the first time they have measured the tiny amount of heat released when an individual bit of data is erased.. In 2014, physical experiments tested Landauer's principle and confirmed its predictions.. In 2016, researchers used a laser probe to measure the amount of energy dissipation that resulted when a
nanomagnet A nanomagnet is a submicrometric system that presents spontaneous magnetic order (magnetization) at zero applied magnetic field ( remanence). The small size of nanomagnets prevents the formation of magnetic domains (see single domain (magnetic)). ...
ic bit flipped from off to on. Flipping the bit required 26 millielectronvolts (4.2 zeptojoules). A 2018 article published in ''
Nature Physics ''Nature Physics'' is a monthly peer-reviewed scientific journal published by Nature Portfolio. It was first published in October 2005 (volume 1, issue 1). The chief editor is Andrea Taroni, who is a full-time professional editor employed by this ...
'' features a Landauer erasure performed at cryogenic temperatures on an array of high-spin (''S'' = 10) quantum molecular magnets. The array is made to act as a spin register where each nanomagnet encodes a single bit of information. The experiment has laid the foundations for the extension of the validity of the Landauer principle to the quantum realm. Owing to the fast dynamics and low "inertia" of the single spins used in the experiment, the researchers also showed how an erasure operation can be carried out at the lowest possible thermodynamic cost—that imposed by the Landauer principle—and at a high speed..


Rationale

Landauer's principle can be understood to be a simple
logical consequence Logical consequence (also entailment) is a fundamental concept in logic, which describes the relationship between statements that hold true when one statement logically ''follows from'' one or more statements. A valid logical argument is on ...
of the second law of thermodynamics, which states that the entropy of an
isolated system In physical science, an isolated system is either of the following: # a physical system so far removed from other systems that it does not interact with them. # a thermodynamic system enclosed by rigid immovable walls through which neither ...
cannot decrease—together with the definition of
thermodynamic temperature Thermodynamic temperature is a quantity defined in thermodynamics as distinct from kinetic theory or statistical mechanics. Historically, thermodynamic temperature was defined by Kelvin in terms of a macroscopic relation between thermodynamic ...
. For, if the number of possible logical states of a computation were to decrease as the computation proceeded forward (logical irreversibility), this would constitute a forbidden decrease of entropy, unless the number of possible physical states corresponding to each logical state were to simultaneously increase by at least a compensating amount, so that the total number of possible physical states was no smaller than it was originally (i.e. total entropy has not decreased). Yet, an increase in the number of physical states corresponding to each logical state means that, for an observer who is keeping track of the physical states of the system but not the logical states, the number of possible physical states has increased; in other words, entropy has increased from the point of view of this observer. The maximum entropy of a bounded physical system is finite. (If the
holographic principle The holographic principle is an axiom in string theories and a supposed property of quantum gravity that states that the description of a volume of space can be thought of as encoded on a lower-dimensional boundary to the region — such as a ...
is correct, then physical systems with finite
surface area The surface area of a solid object is a measure of the total area that the surface of the object occupies. The mathematical definition of surface area in the presence of curved surfaces is considerably more involved than the definition of ...
have a finite maximum entropy; but regardless of the truth of the holographic principle,
quantum field theory In theoretical physics, quantum field theory (QFT) is a theoretical framework that combines classical field theory, special relativity, and quantum mechanics. QFT is used in particle physics to construct physical models of subatomic particles and ...
dictates that the entropy of systems with finite radius and energy is finite due to the
Bekenstein bound In physics, the Bekenstein bound (named after Jacob Bekenstein) is an upper limit on the thermodynamic entropy ''S'', or Shannon entropy ''H'', that can be contained within a given finite region of space which has a finite amount of energy—o ...
.) To avoid reaching this maximum over the course of an extended computation, entropy must eventually be expelled to an outside environment.


Equation

Landauer's principle is based on the more general equation of Leon Brillouin (Brillouin 1956) estimating the energy of one bit of information as the minimum energy of a particle (e.g., photon) that has to overcome the energy of thermal noise to carry the information (formula below). The principle asserts that there is a minimum possible amount of energy required to erase one bit of information, known as the ''Landauer limit'': : E = k_\text T \ln 2, where k_\text is the
Boltzmann constant The Boltzmann constant ( or ) is the proportionality factor that relates the average relative kinetic energy of particles in a gas with the thermodynamic temperature of the gas. It occurs in the definitions of the kelvin and the gas constan ...
(approximately 1.38×10−23 J/K), T is the temperature of the heat sink in
kelvin The kelvin, symbol K, is the primary unit of temperature in the International System of Units (SI), used alongside its prefixed forms and the degree Celsius. It is named after the Belfast-born and University of Glasgow-based engineer and ...
s, and \ln 2 is the
natural logarithm The natural logarithm of a number is its logarithm to the base of the mathematical constant , which is an irrational and transcendental number approximately equal to . The natural logarithm of is generally written as , , or sometimes, if ...
of 2 (approximately 0.69315). After setting T equal to room temperature 20 °C (293.15 K), we can get the Landauer limit of 0.0175 eV (2.805 zJ) per
bit The bit is the most basic unit of information in computing and digital communications. The name is a portmanteau of binary digit. The bit represents a logical state with one of two possible values. These values are most commonly represente ...
erased. The equation can be deduced from
Boltzmann's entropy formula In statistical mechanics, Boltzmann's equation (also known as the Boltzmann–Planck equation) is a probability equation relating the entropy S, also written as S_\mathrm, of an ideal gas to the multiplicity (commonly denoted as \Omega or W), the ...
(S = k_\text \ln W), considering that W is the number of states of the system, which in the case of a bit is 2, and the
entropy Entropy is a scientific concept, as well as a measurable physical property, that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodyna ...
S is defined as E/T. So the operation of erasing a single bit increases the entropy of a value of at least k_\text \ln 2, emitting in the environment a quantity of energy equal or greater than k_\text T \ln 2.


Challenges

The principle is widely accepted as
physical law Scientific laws or laws of science are statements, based on repeated experiments or observations, that describe or predict a range of natural phenomena. The term ''law'' has diverse usage in many cases (approximate, accurate, broad, or narro ...
, but in recent years it has been challenged for using
circular reasoning Circular may refer to: * The shape of a circle * ''Circular'' (album), a 2006 album by Spanish singer Vega * Circular letter (disambiguation) ** Flyer (pamphlet), a form of advertisement * Circular reasoning, a type of logical fallacy * Circula ...
and faulty assumptions, notably in Earman and Norton (1998), and subsequently in Shenker (2000)Logic and Entropy
Critique by Orly Shenker (2000).
and Norton (2004,Eaters of the Lotus
Critique by John Norton (2004).
2011Waiting for Landauer
Response by Norton (2011).
), and defended by Bennett (2003), Ladyman et al. (2007),The Connection between Logical and Thermodynamic Irreversibility
Defense by Ladyman et al. (2007).
and by Jordan and Manikandan (2019).Some Like It Hot
Letter to the Editor in reply to Norton's article by A. Jordan and S. Manikandan (2019).
Other researchers have shown that Landauer's principle is a consequence of the second law of Thermodynamics and the entropy change associated with information gain. On the other hand, recent advances in non-equilibrium statistical physics have established that there is no a priori relationship between logical and thermodynamic reversibility.. It is possible that a physical process is logically reversible but thermodynamically irreversible. It is also possible that a physical process is logically irreversible but thermodynamically reversible. At best, the benefits of implementing a computation with a logically reversible system are nuanced.. In 2016, researchers at the
University of Perugia University of Perugia (Italian ''Università degli Studi di Perugia'') is a public-owned university based in Perugia, Italy. It was founded in 1308, as attested by the Bull issued by Pope Clement V certifying the birth of the Studium Generale. Th ...
claimed to have demonstrated a violation of Landauer’s principle. However, according to Laszlo Kish (2016), their results are invalid because they "neglect the dominant source of energy dissipation, namely, the charging energy of the capacitance of the input electrode".


See also

* Margolus–Levitin theorem *
Bremermann's limit Bremermann's limit, named after Hans-Joachim Bremermann, is a limit on the maximum rate of computation that can be achieved in a self-contained system in the material universe. It is derived from Einstein's mass-energy equivalency and the Heisenb ...
*
Bekenstein bound In physics, the Bekenstein bound (named after Jacob Bekenstein) is an upper limit on the thermodynamic entropy ''S'', or Shannon entropy ''H'', that can be contained within a given finite region of space which has a finite amount of energy—o ...
*
Kolmogorov complexity In algorithmic information theory (a subfield of computer science and mathematics), the Kolmogorov complexity of an object, such as a piece of text, is the length of a shortest computer program (in a predetermined programming language) that produ ...
*
Entropy in thermodynamics and information theory The mathematical expressions for thermodynamic entropy in the statistical thermodynamics formulation established by Ludwig Boltzmann and J. Willard Gibbs in the 1870s are similar to the information entropy by Claude Shannon and Ralph Hartley, develo ...
*
Information theory Information theory is the scientific study of the quantification, storage, and communication of information. The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s. ...
*
Jarzynski equality The Jarzynski equality (JE) is an equation in statistical mechanics that relates free energy differences between two states and the irreversible work along an ensemble of trajectories joining the same states. It is named after the physicist Chris ...
*
Limits to computation The limits of computation are governed by a number of different factors. In particular, there are several physical and practical limits to the amount of computation or data storage that can be performed with a given amount of mass, volume, or energ ...
*
Extended mind thesis In philosophy of mind, the extended mind thesis (EMT) says that the mind does not exclusively reside in the brain or even the body, but extends into the physical world. The EMT proposes that some objects in the external environment can be part o ...
*
Maxwell's demon Maxwell's demon is a thought experiment that would hypothetically violate the second law of thermodynamics. It was proposed by the physicist James Clerk Maxwell in 1867. In his first letter Maxwell called the demon a "finite being", while the ' ...
*
Koomey's law Koomey's law describes a trend in the history of computing hardware: for about a half-century, the number of computations per joule of energy dissipated doubled about every 1.57 years. Professor Jonathan Koomey described the trend in a 2010 pap ...


References


Further reading

*


External links


Public debate on the validity of Landauer's principle (conference Hot Topics in Physical Informatics, November 12, 2013)

Introductory article on Landauer's principle and reversible computing
* Maroney, O.J.E.
Information Processing and Thermodynamic Entropy
The Stanford Encyclopedia of Philosophy. * Eurekalert.org
"Magnetic memory and logic could achieve ultimate energy efficiency"
July 1, 2011 {{Authority control Thermodynamic entropy Entropy and information Philosophy of thermal and statistical physics Principles Limits of computation