HOME

TheInfoList



OR:

In
probability theory Probability theory or probability calculus is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expre ...
, a log-normal (or lognormal) distribution is a continuous
probability distribution In probability theory and statistics, a probability distribution is a Function (mathematics), function that gives the probabilities of occurrence of possible events for an Experiment (probability theory), experiment. It is a mathematical descri ...
of a
random variable A random variable (also called random quantity, aleatory variable, or stochastic variable) is a Mathematics, mathematical formalization of a quantity or object which depends on randomness, random events. The term 'random variable' in its mathema ...
whose
logarithm In mathematics, the logarithm of a number is the exponent by which another fixed value, the base, must be raised to produce that number. For example, the logarithm of to base is , because is to the rd power: . More generally, if , the ...
is
normally distributed In probability theory and statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real number, real-valued random variable. The general form of its probability density function is f(x ...
. Thus, if the random variable is log-normally distributed, then has a normal distribution. Equivalently, if has a normal distribution, then the exponential function of , , has a log-normal distribution. A random variable which is log-normally distributed takes only positive real values. It is a convenient and useful model for measurements in exact and
engineering Engineering is the practice of using natural science, mathematics, and the engineering design process to Problem solving#Engineering, solve problems within technology, increase efficiency and productivity, and improve Systems engineering, s ...
sciences, as well as
medicine Medicine is the science and Praxis (process), practice of caring for patients, managing the Medical diagnosis, diagnosis, prognosis, Preventive medicine, prevention, therapy, treatment, Palliative care, palliation of their injury or disease, ...
,
economics Economics () is a behavioral science that studies the Production (economics), production, distribution (economics), distribution, and Consumption (economics), consumption of goods and services. Economics focuses on the behaviour and interac ...
and other topics (e.g., energies, concentrations, lengths, prices of financial instruments, and other metrics). The distribution is occasionally referred to as the Galton distribution or Galton's distribution, after
Francis Galton Sir Francis Galton (; 16 February 1822 – 17 January 1911) was an English polymath and the originator of eugenics during the Victorian era; his ideas later became the basis of behavioural genetics. Galton produced over 340 papers and b ...
. The log-normal distribution has also been associated with other names, such as McAlister, Gibrat and Cobb–Douglas. A log-normal process is the statistical realization of the multiplicative product of many
independent Independent or Independents may refer to: Arts, entertainment, and media Artist groups * Independents (artist group), a group of modernist painters based in Pennsylvania, United States * Independentes (English: Independents), a Portuguese artist ...
random variable A random variable (also called random quantity, aleatory variable, or stochastic variable) is a Mathematics, mathematical formalization of a quantity or object which depends on randomness, random events. The term 'random variable' in its mathema ...
s, each of which is positive. This is justified by considering the
central limit theorem In probability theory, the central limit theorem (CLT) states that, under appropriate conditions, the Probability distribution, distribution of a normalized version of the sample mean converges to a Normal distribution#Standard normal distributi ...
in the log domain (sometimes called
Gibrat's law Gibrat's law, sometimes called Gibrat's rule of proportionate growth or the law of proportionate effect, is a rule defined by Robert Gibrat (1904–1980) in 1931 stating that the proportional rate of growth of a firm is independent of its absolut ...
). The log-normal distribution is the
maximum entropy probability distribution In statistics and information theory, a maximum entropy probability distribution has entropy that is at least as great as that of all other members of a specified class of probability distributions. According to the principle of maximum entropy, ...
for a random variate —for which the mean and variance of are specified.


Definitions


Generation and parameters

Let Z be a standard normal variable, and let \mu and \sigma be two real numbers, with Then, the distribution of the random variable X = e^ is called the log-normal distribution with parameters \mu and These are the
expected value In probability theory, the expected value (also called expectation, expectancy, expectation operator, mathematical expectation, mean, expectation value, or first Moment (mathematics), moment) is a generalization of the weighted average. Informa ...
(or
mean A mean is a quantity representing the "center" of a collection of numbers and is intermediate to the extreme values of the set of numbers. There are several kinds of means (or "measures of central tendency") in mathematics, especially in statist ...
) and
standard deviation In statistics, the standard deviation is a measure of the amount of variation of the values of a variable about its Expected value, mean. A low standard Deviation (statistics), deviation indicates that the values tend to be close to the mean ( ...
of the variable's natural
logarithm In mathematics, the logarithm of a number is the exponent by which another fixed value, the base, must be raised to produce that number. For example, the logarithm of to base is , because is to the rd power: . More generally, if , the ...
, ''not'' the expectation and standard deviation of X itself. This relationship is true regardless of the base of the logarithmic or exponential function: If \log_a X is normally distributed, then so is \log_b X for any two positive numbers Likewise, if e^Y is log-normally distributed, then so is where In order to produce a distribution with desired mean \mu_X and variance one uses \mu = \ln \frac and Alternatively, the "multiplicative" or "geometric" parameters \mu^* = e^\mu and \sigma^* = e^\sigma can be used. They have a more direct interpretation: \mu^* is the ''
median The median of a set of numbers is the value separating the higher half from the lower half of a Sample (statistics), data sample, a statistical population, population, or a probability distribution. For a data set, it may be thought of as the “ ...
'' of the distribution, and \sigma^* is useful for determining "scatter" intervals, see below.


Probability density function

A positive random variable X is log-normally distributed (i.e., if the natural logarithm of X is normally distributed with mean \mu and variance \ln X \sim \mathcal(\mu,\sigma^2) Let \Phi and \varphi be respectively the cumulative probability distribution function and the probability density function of the \mathcal( 0, 1 ) standard normal distribution, then we have that the
probability density function In probability theory, a probability density function (PDF), density function, or density of an absolutely continuous random variable, is a Function (mathematics), function whose value at any given sample (or point) in the sample space (the s ...
of the log-normal distribution is given by: \begin f_X(x) & = \frac \Pr\nolimits_X\left X \le x \right\\ pt& = \frac \Pr\nolimits_X\left \ln X \le \ln x \right\\ pt& = \frac \Phi \\ pt& = \varphi \frac \left( \frac\right) \\ pt& = \varphi \frac \\ pt& = \frac \exp\left( -\frac \right) ~. \end


Cumulative distribution function

The
cumulative distribution function In probability theory and statistics, the cumulative distribution function (CDF) of a real-valued random variable X, or just distribution function of X, evaluated at x, is the probability that X will take a value less than or equal to x. Ever ...
is F_X(x) = \Phi where \Phi is the cumulative distribution function of the standard normal distribution (i.e., This may also be expressed as follows: \frac \left 1 + \operatorname \left(\frac\right) \right= \frac12 \operatorname \left(-\frac\right) where is the
complementary error function In mathematics, the error function (also called the Gauss error function), often denoted by , is a function \mathrm: \mathbb \to \mathbb defined as: \operatorname z = \frac\int_0^z e^\,\mathrm dt. The integral here is a complex Contour integrat ...
.


Multivariate log-normal

If \boldsymbol X \sim \mathcal(\boldsymbol\mu,\,\boldsymbol\Sigma) is a
multivariate normal distribution In probability theory and statistics, the multivariate normal distribution, multivariate Gaussian distribution, or joint normal distribution is a generalization of the one-dimensional ( univariate) normal distribution to higher dimensions. One d ...
, then Y_i = \exp(X_i) has a multivariate log-normal distribution. The exponential is applied element-wise to the random vector \boldsymbol X. The mean of \boldsymbol Y is \operatorname boldsymbol Yi = e^ , and its
covariance matrix In probability theory and statistics, a covariance matrix (also known as auto-covariance matrix, dispersion matrix, variance matrix, or variance–covariance matrix) is a square matrix giving the covariance between each pair of elements of ...
is \operatorname boldsymbol Y = e^ \left( e^ - 1\right) . Since the multivariate log-normal distribution is not widely used, the rest of this entry only deals with the
univariate distribution In statistics, a univariate distribution is a probability distribution of only one random variable. This is in contrast to a multivariate distribution, the probability distribution of a random vector (consisting of multiple random variables). Exam ...
.


Characteristic function and moment generating function

All moments of the log-normal distribution exist and \operatorname ^n= e^ This can be derived by letting z = \tfrac - n \sigma within the integral. However, the log-normal distribution is not determined by its moments. This implies that it cannot have a defined moment generating function in a neighborhood of zero. Indeed, the expected value \operatorname ^/math> is not defined for any positive value of the argument t, since the defining integral diverges. The
characteristic function In mathematics, the term "characteristic function" can refer to any of several distinct concepts: * The indicator function of a subset, that is the function \mathbf_A\colon X \to \, which for a given subset ''A'' of ''X'', has value 1 at points ...
\operatorname ^/math> is defined for real values of , but is not defined for any complex value of that has a negative imaginary part, and hence the characteristic function is not analytic at the origin. Consequently, the characteristic function of the log-normal distribution cannot be represented as an infinite convergent series. In particular, its Taylor formal series diverges: \sum_^\infty \frac e^ However, a number of alternative
divergent series In mathematics, a divergent series is an infinite series that is not convergent, meaning that the infinite sequence of the partial sums of the series does not have a finite limit. If a series converges, the individual terms of the series mus ...
representations have been obtained. A closed-form formula for the characteristic function \varphi(t) with t in the domain of convergence is not known. A relatively simple approximating formula is available in closed form, and is given byS. Asmussen, J.L. Jensen, L. Rojas-Nandayapa (2016). "On the Laplace transform of the Lognormal distribution"
Methodology and Computing in Applied Probability 18 (2), 441-458.Thiele report 6 (13).
/ref> \varphi(t) \approx \frac where W is the
Lambert W function In mathematics, the Lambert function, also called the omega function or product logarithm, is a multivalued function, namely the Branch point, branches of the converse relation of the function , where is any complex number and is the expone ...
. This approximation is derived via an asymptotic method, but it stays sharp all over the domain of convergence of \varphi.


Properties


Probability in different domains

The probability content of a log-normal distribution in any arbitrary domain can be computed to desired precision by first transforming the variable to normal, then numerically integrating using the ray-trace method.
Matlab code


Probabilities of functions of a log-normal variable

Since the probability of a log-normal can be computed in any domain, this means that the cdf (and consequently pdf and inverse cdf) of any function of a log-normal variable can also be computed.
Matlab code


Geometric or multiplicative moments

The geometric or multiplicative mean of the log-normal distribution is \operatorname = e^\mu = \mu^*. It equals the median. The geometric or multiplicative standard deviation is \operatorname = e^ = \sigma^*. By analogy with the arithmetic statistics, one can define a geometric variance, \operatorname = e^, and a geometric coefficient of variation, \operatorname = e^ - 1, has been proposed. This term was intended to be ''analogous'' to the coefficient of variation, for describing multiplicative variation in log-normal data, but this definition of GCV has no theoretical basis as an estimate of \operatorname itself (see also
Coefficient of variation In probability theory and statistics, the coefficient of variation (CV), also known as normalized root-mean-square deviation (NRMSD), percent RMS, and relative standard deviation (RSD), is a standardized measure of dispersion of a probability ...
). Note that the geometric mean is smaller than the arithmetic mean. This is due to the
AM–GM inequality In mathematics, the inequality of arithmetic and geometric means, or more briefly the AM–GM inequality, states that the arithmetic mean of a list of non-negative real numbers is greater than or equal to the geometric mean of the same list; and ...
and is a consequence of the logarithm being a
concave function In mathematics, a concave function is one for which the function value at any convex combination of elements in the domain is greater than or equal to that convex combination of those domain elements. Equivalently, a concave function is any funct ...
. In fact, \operatorname = e^ = e^ \cdot \sqrt = \operatorname \cdot \sqrt. In finance, the term e^ is sometimes interpreted as a convexity correction. From the point of view of
stochastic calculus Stochastic calculus is a branch of mathematics that operates on stochastic processes. It allows a consistent theory of integration to be defined for integrals of stochastic processes with respect to stochastic processes. This field was created an ...
, this is the same correction term as in Itō's lemma for geometric Brownian motion.


Arithmetic moments

For any real or complex number , the -th moment of a log-normally distributed variable is given by \operatorname ^n= e^. Specifically, the arithmetic mean, expected square, arithmetic variance, and arithmetic standard deviation of a log-normally distributed variable are respectively given by: \begin \operatorname & = e^, \\ pt \operatorname ^2& = e^, \\ pt \operatorname & = \operatorname ^2- \operatorname 2 = ^2 \left(e^ - 1\right) \\ pt &= e^ \left(e^ - 1\right), \\ pt \operatorname & = \sqrt = \operatorname \sqrt \\ pt &= e^ \sqrt, \end The arithmetic
coefficient of variation In probability theory and statistics, the coefficient of variation (CV), also known as normalized root-mean-square deviation (NRMSD), percent RMS, and relative standard deviation (RSD), is a standardized measure of dispersion of a probability ...
\operatorname /math> is the ratio \tfrac. For a log-normal distribution it is equal to \operatorname = \sqrt. This estimate is sometimes referred to as the "geometric CV" (GCV), due to its use of the geometric variance. Contrary to the arithmetic standard deviation, the arithmetic coefficient of variation is independent of the arithmetic mean. The parameters and can be obtained, if the arithmetic mean and the arithmetic variance are known: \begin \mu &= \ln \frac = \ln \frac, \\ ex \sigma^2 &= \ln \frac = \ln \left(1 + \frac\right). \end A probability distribution is not uniquely determined by the moments for . That is, there exist other distributions with the same set of moments. In fact, there is a whole family of distributions with the same moments as the log-normal distribution.


Mode, median, quantiles

The mode is the point of global maximum of the probability density function. In particular, by solving the equation (\ln f)'=0, we get that: \operatorname = e^. Since the log-transformed variable Y = \ln X has a normal distribution, and quantiles are preserved under monotonic transformations, the quantiles of X are q_X(\alpha) = \exp\left mu + \sigma q_\Phi(\alpha)\right= \mu^* (\sigma^*)^, where q_\Phi(\alpha) is the quantile of the standard normal distribution. Specifically, the median of a log-normal distribution is equal to its multiplicative mean, \operatorname = e^\mu = \mu^* ~.


Partial expectation

The partial expectation of a random variable X with respect to a threshold k is defined as g(k) = \int_k^\infty x \, f_X(x \mid X > k)\, dx . Alternatively, by using the definition of
conditional expectation In probability theory, the conditional expectation, conditional expected value, or conditional mean of a random variable is its expected value evaluated with respect to the conditional probability distribution. If the random variable can take on ...
, it can be written as g(k) = \operatorname \mid X>k\Pr(X>k). For a log-normal random variable, the partial expectation is given by: \begin g(k) &= \int_k^\infty x f_X(x \mid X > k)\, dx \\ ex&= e^\, \Phi \end where \Phi is the normal cumulative distribution function. The derivation of the formula is provided in the
Talk page MediaWiki is free and open-source wiki software originally developed by Magnus Manske for use on Wikipedia on January 25, 2002, and further improved by Lee Daniel Crocker, Magnus Manske's announcement of "PHP Wikipedia", wikipedia-l, August 24 ...
. The partial expectation formula has applications in
insurance Insurance is a means of protection from financial loss in which, in exchange for a fee, a party agrees to compensate another party in the event of a certain loss, damage, or injury. It is a form of risk management, primarily used to protect ...
and
economics Economics () is a behavioral science that studies the Production (economics), production, distribution (economics), distribution, and Consumption (economics), consumption of goods and services. Economics focuses on the behaviour and interac ...
, it is used in solving the partial differential equation leading to the Black–Scholes formula.


Conditional expectation

The conditional expectation of a log-normal random variable X—with respect to a threshold k—is its partial expectation divided by the cumulative probability of being in that range: \begin \operatorname \mid X& = e^ \cdot \frac \\ pt\operatorname \mid X \geq k&= e^ \cdot \frac \\ pt\operatorname \mid X\in [k_1,k_2 &= e^ \cdot \frac \end


Alternative parameterizations

In addition to the characterization by \mu, \sigma or \mu^*, \sigma^*, here are multiple ways how the log-normal distribution can be parameterized. ProbOnto, the knowledge base and ontology of
probability distribution In probability theory and statistics, a probability distribution is a Function (mathematics), function that gives the probabilities of occurrence of possible events for an Experiment (probability theory), experiment. It is a mathematical descri ...
s lists seven such forms: * with
mean A mean is a quantity representing the "center" of a collection of numbers and is intermediate to the extreme values of the set of numbers. There are several kinds of means (or "measures of central tendency") in mathematics, especially in statist ...
, , and
standard deviation In statistics, the standard deviation is a measure of the amount of variation of the values of a variable about its Expected value, mean. A low standard Deviation (statistics), deviation indicates that the values tend to be close to the mean ( ...
, , both on the log-scale Forbes et al. Probability Distributions (2011), John Wiley & Sons, Inc. P(x;\boldsymbol\mu,\boldsymbol\sigma) = \frac \exp\left \frac\right/math> * with mean, , and variance, , both on the log-scale P(x;\boldsymbol\mu,\boldsymbol ) = \frac \exp\left \frac\right/math> * with
median The median of a set of numbers is the value separating the higher half from the lower half of a Sample (statistics), data sample, a statistical population, population, or a probability distribution. For a data set, it may be thought of as the “ ...
, , on the natural scale and standard deviation, , on the log-scale P(x;\boldsymbol m,\boldsymbol \sigma) =\frac \exp\left \frac\right/math> * with median, , and
coefficient of variation In probability theory and statistics, the coefficient of variation (CV), also known as normalized root-mean-square deviation (NRMSD), percent RMS, and relative standard deviation (RSD), is a standardized measure of dispersion of a probability ...
, , both on the natural scale P(x;\boldsymbol m,\boldsymbol ) = \frac \exp\left \frac\right/math> * with mean, , and precision, , both on the log-scale P(x;\boldsymbol\mu,\boldsymbol \tau) = \sqrt \frac \exp\left \frac(\ln x-\mu)^2\right/math> * with median, , and geometric standard deviation, , both on the natural scale P(x;\boldsymbol m,\boldsymbol ) = \frac \exp\left \frac\right/math> * with mean, , and standard deviation, , both on the natural scale P(x;\boldsymbol ,\boldsymbol ) = \frac \exp\left \frac\right/math>


Examples for re-parameterization

Consider the situation when one would like to run a model using two different optimal design tools, for example PFIM and PopED. The former supports the LN2, the latter LN7 parameterization, respectively. Therefore, the re-parameterization is required, otherwise the two tools would produce different results. For the transition \operatorname(\mu, v) \to \operatorname(\mu_N, \sigma_N) following formulas hold \mu_N = \exp(\mu+v/2) and \sigma_N = \exp(\mu+v/2)\sqrt. For the transition \operatorname(\mu_N, \sigma_N) \to \operatorname(\mu, v) following formulas hold \mu = \ln \mu_N - \frac v and v = \ln(1+\sigma_N^2/\mu_N^2). All remaining re-parameterisation formulas can be found in the specification document on the project website.ProbOnto website, URL: http://probonto.org


Multiple, reciprocal, power

* Multiplication by a constant: If X \sim \operatorname(\mu, \sigma^2) then a X \sim \operatorname( \mu + \ln a, \sigma^2) for a > 0. * Reciprocal: If X \sim \operatorname(\mu, \sigma^2) then \tfrac \sim \operatorname(-\mu, \sigma^2). * Power: If X \sim \operatorname(\mu, \sigma^2) then X^a \sim \operatorname(a\mu, a^2 \sigma^2) for a \neq 0.


Multiplication and division of independent, log-normal random variables

If two
independent Independent or Independents may refer to: Arts, entertainment, and media Artist groups * Independents (artist group), a group of modernist painters based in Pennsylvania, United States * Independentes (English: Independents), a Portuguese artist ...
, log-normal variables X_1 and X_2 are multiplied ivided the product atiois again log-normal, with parameters \mu = \mu_1 + \mu_2 and where More generally, if X_j \sim \operatorname (\mu_j, \sigma_j^2) are n independent, log-normally distributed variables, then Y = \prod_^n X_j \sim \operatorname \Big( \sum_^n\mu_j, \sum_^n \sigma_j^2 \Big).


Multiplicative central limit theorem

The geometric or multiplicative mean of n independent, identically distributed, positive random variables X_i shows, for n \to \infty, approximately a log-normal distribution with parameters \mu = \operatorname ln X_i/math> and \sigma^2 = \operatorname ln X_i n, assuming \sigma^2 is finite. In fact, the random variables do not have to be identically distributed. It is enough for the distributions of \ln X_i to all have finite variance and satisfy the other conditions of any of the many variants of the
central limit theorem In probability theory, the central limit theorem (CLT) states that, under appropriate conditions, the Probability distribution, distribution of a normalized version of the sample mean converges to a Normal distribution#Standard normal distributi ...
. This is commonly known as
Gibrat's law Gibrat's law, sometimes called Gibrat's rule of proportionate growth or the law of proportionate effect, is a rule defined by Robert Gibrat (1904–1980) in 1931 stating that the proportional rate of growth of a firm is independent of its absolut ...
.


Heavy-tailness of the Log-Normal

Whether a Log-Normal can be considered or not a true heavy-tail distribution is still debated. The main reason is that its variance is always finite, differently from what happen with certain Pareto distributions, for instance. However a recent study has shown how it is possible to create a Log-Normal distribution with infinite variance using Robinson Non-Standard Analysis.


Other

A set of data that arises from the log-normal distribution has a symmetric
Lorenz curve In economics, the Lorenz curve is a graphical representation of the distribution of income or of wealth. It was developed by Max O. Lorenz in 1905 for representing Economic inequality, inequality of the wealth distribution. The curve is a graph ...
(see also Lorenz asymmetry coefficient). The harmonic H, geometric G and arithmetic A means of this distribution are related; such relation is given by H = \frac A. Log-normal distributions are
infinitely divisible Infinite divisibility arises in different ways in philosophy, physics, economics, order theory (a branch of mathematics), and probability theory (also a branch of mathematics). One may speak of infinite divisibility, or the lack thereof, of matter ...
, but they are not
stable distribution In probability theory, a distribution is said to be stable if a linear combination of two independent random variables with this distribution has the same distribution, up to location and scale parameters. A random variable is said to be st ...
s, which can be easily drawn from.


Related distributions

* If X \sim \mathcal(\mu, \sigma^2) is a
normal distribution In probability theory and statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is f(x) = \frac ...
, then \exp(X) \sim \operatorname(\mu, \sigma^2). * If X \sim \operatorname(\mu, \sigma^2) is distributed log-normally, then \ln X \sim \mathcal(\mu, \sigma^2) is a normal random variable. * Let X_j \sim \operatorname(\mu_j, \sigma_j^2) be independent log-normally distributed variables with possibly varying \sigma and \mu parameters, and Y = \sum_^n X_j. The distribution of Y has no closed-form expression, but can be reasonably approximated by another log-normal distribution Z at the right tail. Its probability density function at the neighborhood of 0 has been characterized and it does not resemble any log-normal distribution. A commonly used approximation due to L.F. Fenton (but previously stated by R.I. Wilkinson and mathematically justified by Marlow) is obtained by matching the mean and variance of another log-normal distribution: \begin \sigma^2_Z &= \ln\!\left \frac + 1\right \\ ex \mu_Z &= \ln\!\left \sum_j e^ \right- \frac. \end In the case that all X_j have the same variance parameter these formulas simplify to \begin \sigma^2_Z &= \ln\!\left \left(e^ - 1\right) \frac + 1\right \\ ex \mu_Z &= \ln\!\left \sum_j e^ \right+ \frac - \frac. \end For a more accurate approximation, one can use the
Monte Carlo method Monte Carlo methods, or Monte Carlo experiments, are a broad class of computational algorithms that rely on repeated random sampling to obtain numerical results. The underlying concept is to use randomness to solve problems that might be ...
to estimate the cumulative distribution function, the pdf and the right tail. The sum of correlated log-normally distributed random variables can also be approximated by a log-normal distribution \begin S_+ &= \operatorname\left sum_i X_i \right = \sum_i \operatorname _i = \sum_i e^ \\ ex\sigma^2_ &= \frac \, \sum_ \operatorname_ \sigma_i \sigma_j \operatorname _i\operatorname _j\\ ex &= \frac \, \sum_ \operatorname_ \sigma_i \sigma_j e^ e^ \\ ex \mu_Z &= \ln S_+ - \sigma_^2/2 \end * If X \sim \operatorname(\mu, \sigma^2) then X+c is said to have a ''Three-parameter log-normal'' distribution with support * The log-normal distribution is a special case of the semi-bounded Johnson's SU-distribution. * If X\mid Y \sim \operatorname(Y) with Y \sim \operatorname(\mu, \sigma^2), then X \sim \operatorname(\mu, \sigma) ( Suzuki distribution). * A substitute for the log-normal whose integral can be expressed in terms of more elementary functions can be obtained based on the
logistic distribution In probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It rese ...
to get an approximation for the CDF F(x;\mu,\sigma) = \left left(\frac\right)^ + 1\right. This is a log-logistic distribution.


Statistical inference


Estimation of parameters


Maximum likelihood estimator

For determining the
maximum likelihood In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed stati ...
estimators of the log-normal distribution parameters and , we can use the same procedure as for the
normal distribution In probability theory and statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is f(x) = \frac ...
. Note that L(\mu, \sigma) = \prod_^n \frac 1 \varphi_ (\ln x_i), where \varphi is the density function of the normal distribution \mathcal N(\mu,\sigma^2). Therefore, the log-likelihood function is \ell (\mu,\sigma \mid x_1, x_2, \ldots, x_n) = - \sum _i \ln x_i + \ell_N (\mu, \sigma \mid \ln x_1, \ln x_2, \dots, \ln x_n). Since the first term is constant with regard to ''μ'' and ''σ'', both logarithmic likelihood functions, \ell and \ell_N, reach their maximum with the same \mu and \sigma. Hence, the maximum likelihood estimators are identical to those for a normal distribution for the observations \ln x_1, \ln x_2, \dots, \ln x_n), \widehat \mu = \frac , \qquad \widehat \sigma^2 = \frac . For finite ''n'', the estimator for \mu is unbiased, but the one for \sigma is biased. As for the normal distribution, an unbiased estimator for \sigma can be obtained by replacing the denominator ''n'' by ''n''−1 in the equation for \widehat\sigma^2. From this, the MLE for the expectancy of x is: \widehat_\text = \widehat_\text = e^


Method of moments

When the individual values x_1, x_2, \ldots, x_n are not available, but the sample's mean \bar x and
standard deviation In statistics, the standard deviation is a measure of the amount of variation of the values of a variable about its Expected value, mean. A low standard Deviation (statistics), deviation indicates that the values tend to be close to the mean ( ...
''s'' is, then the method of moments can be used. The corresponding parameters are determined by the following formulas, obtained from solving the equations for the expectation \operatorname /math> and variance \operatorname /math> for \mu and \sigma: \begin \mu &= \ln \frac , \\ ex\sigma^2 &= \ln\left(1 + / \bar x^2 \right). \end


Other estimators

Other estimators also exist, such as Finney's UMVUE estimator, the "Approximately Minimum Mean Squared Error Estimator", the "Approximately Unbiased Estimator" and "Minimax Estimator", also "A Conditional Mean Squared Error Estimator", and other variations as well.


Interval estimates

The most efficient way to obtain interval estimates when analyzing log-normally distributed data consists of applying the well-known methods based on the normal distribution to logarithmically transformed data and then to back-transform results if appropriate.


Prediction intervals

A basic example is given by
prediction interval In statistical inference, specifically predictive inference, a prediction interval is an estimate of an interval (statistics), interval in which a future observation will fall, with a certain probability, given what has already been observed. Pr ...
s: For the normal distribution, the interval mu-\sigma,\mu+\sigma/math> contains approximately two thirds (68%) of the probability (or of a large sample), and mu-2\sigma,\mu+2\sigma/math> contain 95%. Therefore, for a log-normal distribution, * mu^*/\sigma^*,\mu^*\cdot\sigma^* mu^* ^\times\!\!/ \sigma^*/math> contains 2/3, and * mu^*/(\sigma^*)^2,\mu^*\cdot(\sigma^*)^2= mu^* ^\times\!\!/ (\sigma^*)^2/math> contains 95% of the probability. Using estimated parameters, then approximately the same percentages of the data should be contained in these intervals.


Confidence interval for ''eμ''

Using the principle, note that a confidence interval for \mu is widehat\mu \pm q \cdot \widehat\mathop/math>, where \mathop = \widehat\sigma / \sqrt is the standard error and ''q'' is the 97.5% quantile of a t distribution with ''n-1'' degrees of freedom. Back-transformation leads to a confidence interval for \mu^* = e^\mu (the median), is: widehat\mu^* ^\times\!\!/ (\operatorname^*)^q/math> with \operatorname^*=(\widehat\sigma^*)^


Confidence interval for

The literature discusses several options for calculating the confidence interval for \mu (the mean of the log-normal distribution). These include bootstrap as well as various other methods.Olsson, Ulf. "Confidence intervals for the mean of a log-normal distribution." ''Journal of Statistics Education'' 13.1 (2005
pdf
/ref> The Cox Method proposes to plug-in the estimators \widehat \mu = \frac , \qquad S^2 = \frac and use them to construct approximate confidence intervals in the following way: \mathrm(\operatorname(X)) : \exp\left(\hat \mu + \frac \pm z_ \sqrt \right) We know that Also, \widehat \mu is a normal distribution with parameters: \widehat \mu \sim N\left(\mu, \frac\right) S^2 has a
chi-squared distribution In probability theory and statistics, the \chi^2-distribution with k Degrees of freedom (statistics), degrees of freedom is the distribution of a sum of the squares of k Independence (probability theory), independent standard normal random vari ...
, which is approximately normally distributed (via CLT), with parameters: Hence, Since the sample mean and variance are independent, and the sum of normally distributed variables is also normal, we get that: \widehat \mu + \frac \dot \sim N\left(\mu + \frac, \frac + \frac\right) Based on the above, standard confidence intervals for \mu + \frac can be constructed (using a
Pivotal quantity In statistics, a pivotal quantity or pivot is a function of observations and unobservable parameters such that the function's probability distribution does not depend on the unknown parameters (including nuisance parameters). A pivot need not be a ...
) as: \hat \mu + \frac \pm z_ \sqrt And since confidence intervals are preserved for monotonic transformations, we get that: \mathrm\left(\operatorname = e^\right): \exp\left(\hat \mu + \frac \pm z_ \sqrt \right) As desired. Olsson 2005, proposed a "modified Cox method" by replacing z_ with t_, which seemed to provide better coverage results for small sample sizes.


Confidence interval for comparing two log normals

Comparing two log-normal distributions can often be of interest, for example, from a treatment and control group (e.g., in an A/B test). We have samples from two independent log-normal distributions with parameters (\mu_1, \sigma_1^2) and (\mu_2, \sigma_2^2), with sample sizes n_1 and n_2 respectively. Comparing the medians of the two can easily be done by taking the log from each and then constructing straightforward confidence intervals and transforming it back to the exponential scale. \mathrm(e^): \exp\left(\hat \mu_1 - \hat \mu_2 \pm z_ \sqrt \right) These CI are what's often used in epidemiology for calculation the CI for relative-risk and odds-ratio. The way it is done there is that we have two approximately Normal distributions (e.g., p1 and p2, for RR), and we wish to calculate their ratio. However, the ratio of the expectations (means) of the two samples might also be of interest, while requiring more work to develop. The ratio of their means is: \frac = \frac = e^ Plugin in the estimators to each of these parameters yields also a log normal distribution, which means that the Cox Method, discussed above, could similarly be used for this use-case: \mathrm\left( \frac = \frac \right): \exp\left(\left(\hat \mu_1 - \hat \mu_2 + \tfracS_1^2 - \tfracS_2^2\right) \pm z_ \sqrt \right) To construct a confidence interval for this ratio, we first note that \hat \mu_1 - \hat \mu_2 follows a normal distribution, and that both S_1^2 and S_2^2 has a
chi-squared distribution In probability theory and statistics, the \chi^2-distribution with k Degrees of freedom (statistics), degrees of freedom is the distribution of a sum of the squares of k Independence (probability theory), independent standard normal random vari ...
, which is approximately normally distributed (via CLT, with the relevant parameters). This means that (\hat \mu_1 - \hat \mu_2 + \fracS_1^2 - \fracS_2^2) \sim N\left((\mu_1 - \mu_2) + \frac(\sigma_1^2 - \sigma_2^2), \frac + \frac + \frac + \frac \right) Based on the above, standard confidence intervals can be constructed (using a
Pivotal quantity In statistics, a pivotal quantity or pivot is a function of observations and unobservable parameters such that the function's probability distribution does not depend on the unknown parameters (including nuisance parameters). A pivot need not be a ...
) as: (\hat \mu_1 - \hat \mu_2 + \fracS_1^2 - \fracS_2^2) \pm z_ \sqrt And since confidence intervals are preserved for monotonic transformations, we get that: CI\left( \frac = \frac \right):e^ As desired. It's worth noting that naively using the MLE in the ratio of the two expectations to create a
ratio estimator The ratio estimator is a statistical estimator for the ratio of means of two random variables. Ratio estimates are biased and corrections must be made when they are used in experimental or survey work. The ratio estimates are asymmetrical and symm ...
will lead to a
consistent In deductive logic, a consistent theory is one that does not lead to a logical contradiction. A theory T is consistent if there is no formula \varphi such that both \varphi and its negation \lnot\varphi are elements of the set of consequences ...
, yet biased, point-estimation (we use the fact that the estimator of the ratio is a log normal distribution): \begin \operatorname\left \frac \right&= \operatorname\left exp\left(\left(\widehat \mu_1 - \widehat \mu_2\right) + \tfrac \left(S_1^2 - S_2^2\right)\right)\right\\ &\approx \exp\left
right Rights are law, legal, social, or ethics, ethical principles of freedom or Entitlement (fair division), entitlement; that is, rights are the fundamental normative rules about what is allowed of people or owed to people according to some legal sy ...
\end


Extremal principle of entropy to fix the free parameter ''σ''

In applications, \sigma is a parameter to be determined. For growing processes balanced by production and dissipation, the use of an extremal principle of Shannon entropy shows that \sigma = \frac 1 \sqrt This value can then be used to give some scaling relation between the inflexion point and maximum point of the log-normal distribution. This relationship is determined by the base of natural logarithm, e = 2.718\ldots, and exhibits some geometrical similarity to the minimal surface energy principle. These scaling relations are useful for predicting a number of growth processes (epidemic spreading, droplet splashing, population growth, swirling rate of the bathtub vortex, distribution of language characters, velocity profile of turbulences, etc.). For example, the log-normal function with such \sigma fits well with the size of secondarily produced droplets during droplet impact and the spreading of an epidemic disease. The value \sigma = 1 \big/ \sqrt is used to provide a probabilistic solution for the Drake equation.


Occurrence and applications

The log-normal distribution is important in the description of natural phenomena. Many natural growth processes are driven by the accumulation of many small percentage changes which become additive on a log scale. Under appropriate regularity conditions, the distribution of the resulting accumulated changes will be increasingly well approximated by a log-normal, as noted in the section above on " Multiplicative Central Limit Theorem". This is also known as
Gibrat's law Gibrat's law, sometimes called Gibrat's rule of proportionate growth or the law of proportionate effect, is a rule defined by Robert Gibrat (1904–1980) in 1931 stating that the proportional rate of growth of a firm is independent of its absolut ...
, after Robert Gibrat (1904–1980) who formulated it for companies. If the rate of accumulation of these small changes does not vary over time, growth becomes independent of size. Even if this assumption is not true, the size distributions at any age of things that grow over time tends to be log-normal. Consequently, reference ranges for measurements in healthy individuals are more accurately estimated by assuming a log-normal distribution than by assuming a symmetric distribution about the mean. A second justification is based on the observation that fundamental natural laws imply multiplications and divisions of positive variables. Examples are the simple gravitation law connecting masses and distance with the resulting force, or the formula for equilibrium concentrations of chemicals in a solution that connects concentrations of educts and products. Assuming log-normal distributions of the variables involved leads to consistent models in these cases. Specific examples are given in the following subsections. contains a review and table of log-normal distributions from geology, biology, medicine, food, ecology, and other areas. is a review article on log-normal distributions in neuroscience, with annotated bibliography.


Human behavior

* The length of comments posted in Internet discussion forums follows a log-normal distribution. * Users' dwell time on online articles (jokes, news etc.) follows a log-normal distribution. * The length of
chess Chess is a board game for two players. It is an abstract strategy game that involves Perfect information, no hidden information and no elements of game of chance, chance. It is played on a square chessboard, board consisting of 64 squares arran ...
games tends to follow a log-normal distribution. * Onset durations of acoustic comparison stimuli that are matched to a standard stimulus follow a log-normal distribution.


Biology and medicine

* Measures of size of living tissue (length, skin area, weight). * Incubation period of diseases. * Diameters of banana leaf spots, powdery mildew on barley. * For highly communicable epidemics, such as SARS in 2003, if public intervention control policies are involved, the number of hospitalized cases is shown to satisfy the log-normal distribution with no free parameters if an entropy is assumed and the standard deviation is determined by the principle of maximum rate of
entropy production Entropy production (or generation) is the amount of entropy which is produced during heat process to evaluate the efficiency of the process. Short history Entropy is produced in irreversible processes. The importance of avoiding irreversible p ...
. * The length of inert appendages (hair, claws, nails, teeth) of biological specimens, in the direction of growth. * The normalised RNA-Seq readcount for any genomic region can be well approximated by log-normal distribution. * The PacBio sequencing read length follows a log-normal distribution. * Certain physiological measurements, such as blood pressure of adult humans (after separation on male/female subpopulations). *Several
pharmacokinetic Pharmacokinetics (from Ancient Greek ''pharmakon'' "drug" and ''kinetikos'' "moving, putting in motion"; see chemical kinetics), sometimes abbreviated as PK, is a branch of pharmacology dedicated to describing how the body affects a specific subs ...
variables, such as Cmax,
elimination half-life Biological half-life (elimination half-life, pharmacological half-life) is the time taken for concentration of a biological substance (such as a medication) to decrease from its maximum concentration ( Cmax) to half of Cmax in the blood plasma. ...
and the elimination rate constant. * In neuroscience, the distribution of firing rates across a population of neurons is often approximately log-normal. This has been first observed in the cortex and striatum and later in hippocampus and entorhinal cortex, and elsewhere in the brain. Also, intrinsic gain distributions and synaptic weight distributions appear to be log-normal as well. *Neuron densities in the cerebral cortex, due to the noisy cell division process during neurodevelopment. *In operating-rooms management, the distribution of surgery duration. *In the size of avalanches of fractures in the cytoskeleton of living cells, showing log-normal distributions, with significantly higher size in cancer cells than healthy ones.


Chemistry

*
Particle size distribution In the physical sciences, a particle (or corpuscle in older texts) is a small localized object which can be described by several physical or chemical properties, such as volume, density, or mass. They vary greatly in size or quantity, from s ...
s and
molar mass distribution In polymer chemistry, the molar mass distribution (or molecular weight distribution) describes the relationship between the number of moles of each polymer species () and the molar mass () of that species. In linear polymers, the individual polym ...
s. * The concentration of rare elements in minerals. * Diameters of crystals in ice cream, oil drops in mayonnaise, pores in cocoa press cake.


Physical sciences

*In
hydrology Hydrology () is the scientific study of the movement, distribution, and management of water on Earth and other planets, including the water cycle, water resources, and drainage basin sustainability. A practitioner of hydrology is called a hydro ...
, the log-normal distribution is used to analyze extreme values of such variables as monthly and annual maximum values of daily rainfall and river discharge volumes. **The image on the right illustrates an example of fitting the log-normal distribution to ranked annually maximum one-day rainfalls showing also the 90% confidence belt based on the
binomial distribution In probability theory and statistics, the binomial distribution with parameters and is the discrete probability distribution of the number of successes in a sequence of statistical independence, independent experiment (probability theory) ...
. **The rainfall data are represented by plotting positions as part of a cumulative frequency analysis. *In
physical oceanography Physical oceanography is the study of physical conditions and physical processes within the ocean, especially the motions and physical properties of ocean waters. Physical oceanography is one of several sub-domains into which oceanography is div ...
, the sizes of icebergs in the midwinter Southern Atlantic Ocean were found to follow a log-normal size distribution. The iceberg sizes, measured visually and by radar from the F.S. ''Polarstern'' in 1986, were thought to be controlled by wave action in heavy seas causing them to flex and break. *In
atmospheric science Atmospheric science is the study of the Atmosphere of Earth, Earth's atmosphere and its various inner-working physical processes. Meteorology includes atmospheric chemistry and atmospheric physics with a major focus on weather forecasting. Clima ...
, log-normal distributions (or distributions made by combining multiple log-normal functions) have been used to characterize both measurements and models of the sizes and concentrations of many different types of particles, from volcanic ash, to clouds and rain, to airborne microbes. The log-normal distribution is strictly empirical, so more physically-based distributions have been adopted to better understand processes controlling size distributions of particles such as volcanic ash.


Social sciences and demographics

* In
economics Economics () is a behavioral science that studies the Production (economics), production, distribution (economics), distribution, and Consumption (economics), consumption of goods and services. Economics focuses on the behaviour and interac ...
, there is evidence that the
income Income is the consumption and saving opportunity gained by an entity within a specified timeframe, which is generally expressed in monetary terms. Income is difficult to define conceptually and the definition may be different across fields. F ...
of 97–99% of the population is distributed log-normally. (The distribution of higher-income individuals follows a
Pareto distribution The Pareto distribution, named after the Italian civil engineer, economist, and sociologist Vilfredo Pareto, is a power-law probability distribution that is used in description of social, quality control, scientific, geophysical, actuarial scien ...
). * If an income distribution follows a log-normal distribution with standard deviation \sigma, then the
Gini coefficient In economics, the Gini coefficient ( ), also known as the Gini index or Gini ratio, is a measure of statistical dispersion intended to represent the income distribution, income inequality, the wealth distribution, wealth inequality, or the ...
, commonly use to evaluate income inequality, can be computed as G = \operatorname\left(\frac\right) where \operatorname is the
error function In mathematics, the error function (also called the Gauss error function), often denoted by , is a function \mathrm: \mathbb \to \mathbb defined as: \operatorname z = \frac\int_0^z e^\,\mathrm dt. The integral here is a complex Contour integrat ...
, since G = 2 \Phi - 1, where \Phi(x) is the cumulative distribution function of a standard normal distribution. * In
finance Finance refers to monetary resources and to the study and Academic discipline, discipline of money, currency, assets and Liability (financial accounting), liabilities. As a subject of study, is a field of Business administration, Business Admin ...
, in particular the
Black–Scholes model The Black–Scholes or Black–Scholes–Merton model is a mathematical model for the dynamics of a financial market containing Derivative (finance), derivative investment instruments. From the parabolic partial differential equation in the model, ...
, changes in the ''logarithm'' of exchange rates, price indices, and stock market indices are assumed normal (these variables behave like compound interest, not like simple interest, and so are multiplicative). However, some mathematicians such as
Benoit Mandelbrot Benoit B. Mandelbrot (20 November 1924 – 14 October 2010) was a Polish-born French-American mathematician and polymath with broad interests in the practical sciences, especially regarding what he labeled as "the art of roughness" of phy ...
have argued that log-Lévy distributions, which possesses heavy tails would be a more appropriate model, in particular for the analysis for
stock market crash A stock market crash is a sudden dramatic decline of stock prices across a major cross-section of a stock market, resulting in a significant loss of paper wealth. Crashes are driven by panic selling and underlying economic factors. They often fol ...
es. Indeed, stock price distributions typically exhibit a fat tail. The fat tailed distribution of changes during stock market crashes invalidate the assumptions of the
central limit theorem In probability theory, the central limit theorem (CLT) states that, under appropriate conditions, the Probability distribution, distribution of a normalized version of the sample mean converges to a Normal distribution#Standard normal distributi ...
. * In
scientometrics Scientometrics is a subfield of informetrics that studies quantitative aspects of scholarly literature. Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citati ...
, the number of citations to journal articles and patents follows a discrete log-normal distribution. * City sizes (population) satisfy Gibrat's Law. The growth process of city sizes is proportionate and invariant with respect to size. From the
central limit theorem In probability theory, the central limit theorem (CLT) states that, under appropriate conditions, the Probability distribution, distribution of a normalized version of the sample mean converges to a Normal distribution#Standard normal distributi ...
therefore, the log of city size is normally distributed. * The number of sexual partners appears to be best described by a log-normal distribution.


Technology

* In reliability analysis, the log-normal distribution is often used to model times to repair a maintainable system. * In
wireless communication Wireless communication (or just wireless, when the context allows) is the transfer of information (''telecommunication'') between two or more points without the use of an electrical conductor, optical fiber or other continuous guided med ...
, "the local-mean power expressed in logarithmic values, such as dB or neper, has a normal (i.e., Gaussian) distribution." Also, the random obstruction of radio signals due to large buildings and hills, called shadowing, is often modeled as a log-normal distribution. * Particle size distributions produced by comminution with random impacts, such as in ball milling. * The
file size File size is a measure of how much data a computer file contains or how much storage space it is allocated. Typically, file size is expressed in units based on byte. A large value is often expressed with a metric prefix (as in megabyte and giga ...
distribution of publicly available audio and video data files ( MIME types) follows a log-normal distribution over five
orders of magnitude In a ratio scale based on powers of ten, the order of magnitude is a measure of the nearness of two figures. Two numbers are "within an order of magnitude" of each other if their ratio is between 1/10 and 10. In other words, the two numbers are wi ...
. * File sizes of 140 million files on personal computers running the Windows OS, collected in 1999. * Sizes of text-based emails (1990s) and multimedia-based emails (2000s). * In computer networks and
Internet traffic Internet traffic is the flow of data within the entire Internet, or in certain network links of its constituent networks. Common traffic measurements are total volume, in units of multiples of the byte, or as transmission rates in bytes per cert ...
analysis, log-normal is shown as a good statistical model to represent the amount of traffic per unit time. This has been shown by applying a robust statistical approach on a large groups of real Internet traces. In this context, the log-normal distribution has shown a good performance in two main use cases: (1) predicting the proportion of time traffic will exceed a given level (for service level agreement or link capacity estimation) i.e. link dimensioning based on bandwidth provisioning and (2) predicting 95th percentile pricing. * in
physical test A physical test is a qualitative or quantitative procedure that consists of determination of one or more characteristics of a given product, process or service according to a specified procedure.ASTM E 1301, Standard Guide for Proficiency Testing ...
ing when the test produces a time-to-failure of an item under specified conditions, the data is often best analyzed using a lognormal distribution.ASTM D4577, Standard Test Method for Compression Resistance of a container Under Constant Load>\


See also

*
Heavy-tailed distribution In probability theory, heavy-tailed distributions are probability distributions whose tails are not exponentially bounded: that is, they have heavier tails than the exponential distribution. Roughly speaking, “heavy-tailed” means the distribu ...
* Log-distance path loss model * Modified lognormal power-law distribution *
Fading In wireless communications, fading is the variation of signal attenuation over variables like time, geographical position, and radio frequency. Fading is often modeled as a random process. In wireless systems, fading may either be due to mul ...


Notes


References


Further reading

* * * * *


External links


The normal distribution is the log-normal distribution
{{DEFAULTSORT:Log-Normal Distribution Continuous distributions Normal distribution Exponential family distributions Infinitely divisible probability distributions Non-Newtonian calculus