|
Tsallis Entropy
In physics, the Tsallis entropy is a generalization of the standard Boltzmann–Gibbs entropy. Overview The concept was introduced in 1988 by Constantino Tsallis as a basis for generalizing the standard statistical mechanics and is identical in form to Havrda–Charvát structural α-entropy, introduced in 1967 within information theory. In scientific literature, the physical relevance of the Tsallis entropy has been debated. However, from the years 2000 on, an increasingly wide spectrum of natural, artificial and social complex systems have been identified which confirm the predictions and consequences that are derived from this nonadditive entropy, such as nonextensive statistical mechanics, which generalizes the Boltzmann–Gibbs theory. Among the various experimental verifications and applications presently available in the literature, the following ones deserve a special mention: # The distribution characterizing the motion of cold atoms in dissipative optical lattices pr ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Entropy (statistical Thermodynamics)
The concept entropy was first developed by German physicist Rudolf Clausius in the mid-nineteenth century as a thermodynamic property that predicts that certain spontaneous processes are irreversible or impossible. In statistical mechanics, entropy is formulated as a statistical property using probability theory. The statistical entropy perspective was introduced in 1870 by Austrian physicist Ludwig Boltzmann, who established a new field of physics that provided the descriptive linkage between the macroscopic observation of nature and the microscopic view based on the rigorous treatment of a large ensembles of microstates that constitute thermodynamic systems. Boltzmann's principle Ludwig Boltzmann defined entropy as a measure of the number of possible microscopic states (''microstates'') of a system in thermodynamic equilibrium, consistent with its macroscopic thermodynamic properties, which constitute the ''macrostate'' of the system. A useful illustration is the example of a sam ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Overdamped
Damping is an influence within or upon an oscillatory system that has the effect of reducing or preventing its oscillation. In physical systems, damping is produced by processes that dissipate the energy stored in the oscillation. Examples include viscous drag (a liquid's viscosity can hinder an oscillatory system, causing it to slow down; see viscous damping) in mechanical systems, resistance in electronic oscillators, and absorption and scattering of light in optical oscillators. Damping not based on energy loss can be important in other oscillating systems such as those that occur in biological systems and bikes (ex. Suspension (mechanics)). Not to be confused with friction, which is a dissipative force acting on a system. Friction can cause or be a factor of damping. The damping ratio is a dimensionless measure describing how oscillations in a system decay after a disturbance. Many systems exhibit oscillatory behavior when they are disturbed from their position of stat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Entropy And Information
Entropy is a scientific concept, as well as a measurable physical property, that is most commonly associated with a state of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change, and information systems including the transmission of information in telecommunication. The thermodynamic concept was referred to by Scottish scientist and engineer William Rankine in 1850 with the names ''thermodynamic function'' and ''heat-potential''. In 1865, German physicist Rudolf Clausius, one of the leading founders of the field of thermodynamics, defined it as the quotient of an infinitesimal amount of heat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Statistical Mechanics
In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. It does not assume or postulate any natural laws, but explains the macroscopic behavior of nature from the behavior of such ensembles. Statistical mechanics arose out of the development of classical thermodynamics, a field for which it was successful in explaining macroscopic physical properties—such as temperature, pressure, and heat capacity—in terms of microscopic parameters that fluctuate about average values and are characterized by probability distributions. This established the fields of statistical thermodynamics and statistical physics. The founding of the field of statistical mechanics is generally credited to three physicists: *Ludwig Boltzmann, who developed the fundamental interpretation of entropy in terms of a collection of microstates *James Clerk Maxwell, who developed models of probability distr ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Rényi Entropy
In information theory, the Rényi entropy is a quantity that generalizes various notions of entropy, including Hartley entropy, Shannon entropy, collision entropy, and min-entropy. The Rényi entropy is named after Alfréd Rényi, who looked for the most general way to quantify information while preserving additivity for independent events. In the context of fractal dimension estimation, the Rényi entropy forms the basis of the concept of generalized dimensions. The Rényi entropy is important in ecology and statistics as index of diversity. The Rényi entropy is also important in quantum information, where it can be used as a measure of entanglement. In the Heisenberg XY spin chain model, the Rényi entropy as a function of can be calculated explicitly because it is an automorphic function with respect to a particular subgroup of the modular group. In theoretical computer science, the min-entropy is used in the context of randomness extractors. Definition The Rényi entro ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Functional (mathematics)
In mathematics, a functional (as a noun) is a certain type of function. The exact definition of the term varies depending on the subfield (and sometimes even the author). * In linear algebra, it is synonymous with linear forms, which are linear mapping from a vector space V into its Field (mathematics), field of scalars (that is, an element of the dual space V^*) "Let ''E'' be a free module over a commutative ring ''A''. We view ''A'' as a free module of rank 1 over itself. By the dual module ''E''∨ of ''E'' we shall mean the module Hom(''E'', ''A''). Its elements will be called functionals. Thus a functional on ''E'' is an ''A''-linear map ''f'' : ''E'' → ''A''." * In functional analysis and related fields, it refers more generally to a mapping from a space X into the field of Real numbers, real or complex numbers. "A numerical function ''f''(''x'') defined on a normed linear space ''R'' will be called a ''functional''. A functional ''f''(''x'') is said to be ''linear'' ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Proceedings Of The National Academy Of Sciences
''Proceedings of the National Academy of Sciences of the United States of America'' (often abbreviated ''PNAS'' or ''PNAS USA'') is a peer-reviewed multidisciplinary scientific journal. It is the official journal of the National Academy of Sciences, published since 1915, and publishes original research, scientific reviews, commentaries, and letters. According to ''Journal Citation Reports'', the journal has a 2021 impact factor of 12.779. ''PNAS'' is the second most cited scientific journal, with more than 1.9 million cumulative citations from 2008 to 2018. In the mass media, ''PNAS'' has been described variously as "prestigious", "sedate", "renowned" and "high impact". ''PNAS'' is a delayed open access journal, with an embargo period of six months that can be bypassed for an author fee ( hybrid open access). Since September 2017, open access articles are published under a Creative Commons license. Since January 2019, ''PNAS'' has been online-only, although print issues are a ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Exponential Families
In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, including the enabling of the user to calculate expectations, covariances using differentiation based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family", or the older term Koopman–Darmois family. The terms "distribution" and "family" are often used loosely: specifically, ''an'' exponential family is a ''set'' of distributions, where the specific distribution varies with the parameter; however, a parametric ''family'' of distributions is often referred to as "''a'' distribution" (like "the normal distribution", meaning "the family of normal distributions"), and the set of all exponential families is sometimes lo ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Q-derivative
In mathematics, in the area of combinatorics and quantum calculus, the ''q''-derivative, or Jackson derivative, is a q-analog, ''q''-analog of the ordinary derivative, introduced by Frank Hilton Jackson. It is the inverse of Jackson integral, Jackson's ''q''-integration. For other forms of q-derivative, see . Definition The ''q''-derivative of a function ''f''(''x'') is defined as :\left(\frac\right)_q f(x)=\frac. It is also often written as D_qf(x). The ''q''-derivative is also known as the Jackson derivative. Formally, in terms of Lagrange's shift operator in logarithmic variables, it amounts to the operator :D_q= \frac ~ \frac ~, which goes to the plain derivative \to \frac as q \to 1. It is manifestly linear, :\displaystyle D_q (f(x)+g(x)) = D_q f(x) + D_q g(x)~. It has a product rule analogous to the ordinary derivative product rule, with two equivalent forms :\displaystyle D_q (f(x)g(x)) = g(x)D_q f(x) + f(qx)D_q g(x) = g(qx)D_q f(x) + f(x)D_q g(x). Similarly, it sat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Tsallis Distribution
In statistics, a Tsallis distribution is a probability distribution derived from the maximization of the Tsallis entropy under appropriate constraints. There are several different families of Tsallis distributions, yet different sources may reference an individual family as "the Tsallis distribution". The q-Gaussian is a generalization of the Gaussian in the same way that Tsallis entropy is a generalization of standard Boltzmann–Gibbs entropy or Shannon entropy. Similarly, if the domain of the variable is constrained to be positive in the maximum entropy procedure, the q-exponential distribution is derived. The Tsallis distributions have been applied to problems in the fields of statistical mechanics, geology, anatomy, astronomy, economics, finance, and machine learning. The distributions are often used for their heavy tails. Note that Tsallis distributions are obtained as Box–Cox transformation over usual distributions, with deformation parameter \lambda=1-q. This deformati ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Principle Of Maximum Entropy
The principle of maximum entropy states that the probability distribution which best represents the current state of knowledge about a system is the one with largest entropy, in the context of precisely stated prior data (such as a proposition that expresses testable information). Another way of stating this: Take precisely stated prior data or testable information about a probability distribution function. Consider the set of all trial probability distributions that would encode the prior data. According to this principle, the distribution with maximal information entropy is the best choice. History The principle was first expounded by E. T. Jaynes in two papers in 1957 where he emphasized a natural correspondence between statistical mechanics and information theory. In particular, Jaynes offered a new and very general rationale why the Gibbsian method of statistical mechanics works. He argued that the entropy of statistical mechanics and the information entropy of informati ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Probability Density Function
In probability theory, a probability density function (PDF), or density of a continuous random variable, is a function whose value at any given sample (or point) in the sample space (the set of possible values taken by the random variable) can be interpreted as providing a ''relative likelihood'' that the value of the random variable would be close to that sample. Probability density is the probability per unit length, in other words, while the ''absolute likelihood'' for a continuous random variable to take on any particular value is 0 (since there is an infinite set of possible values to begin with), the value of the PDF at two different samples can be used to infer, in any particular draw of the random variable, how much more likely it is that the random variable would be close to one sample compared to the other sample. In a more precise sense, the PDF is used to specify the probability of the random variable falling ''within a particular range of values'', as opposed to ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
