Stochastic Differential Geometry
   HOME

TheInfoList



OR:

Stochastic (, ) refers to the property of being well described by a random
probability distribution In probability theory and statistics, a probability distribution is the mathematical function that gives the probabilities of occurrence of different possible outcomes for an experiment. It is a mathematical description of a random phenomenon i ...
. Although stochasticity and randomness are distinct in that the former refers to a modeling approach and the latter refers to phenomena themselves, these two terms are often used
synonymous A synonym is a word, morpheme, or phrase that means exactly or nearly the same as another word, morpheme, or phrase in a given language. For example, in the English language, the words ''begin'', ''start'', ''commence'', and ''initiate'' are all ...
ly. Furthermore, in probability theory, the formal concept of a ''
stochastic process In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
'' is also referred to as a ''random process''. Stochasticity is used in many different fields, including the natural sciences such as biology,
chemistry Chemistry is the science, scientific study of the properties and behavior of matter. It is a natural science that covers the Chemical element, elements that make up matter to the chemical compound, compounds made of atoms, molecules and ions ...
, ecology, neuroscience, and physics, as well as technology and engineering fields such as
image processing An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
, signal processing,
information theory Information theory is the scientific study of the quantification (science), quantification, computer data storage, storage, and telecommunication, communication of information. The field was originally established by the works of Harry Nyquist a ...
, computer science, cryptography, and telecommunications. It is also used in finance, due to seemingly random changes in financial markets as well as in medicine, linguistics, music, media, colour theory, botany, manufacturing, and geomorphology.


Etymology

The word ''stochastic'' in English was originally used as an adjective with the definition "pertaining to conjecturing", and stemming from a Greek word meaning "to aim at a mark, guess", and the Oxford English Dictionary gives the year 1662 as its earliest occurrence. In his work on probability ''Ars Conjectandi'', originally published in Latin in 1713, Jakob Bernoulli used the phrase "Ars Conjectandi sive Stochastice", which has been translated to "the art of conjecturing or stochastics". This phrase was used, with reference to Bernoulli, by Ladislaus Bortkiewicz, who in 1917 wrote in German the word ''Stochastik'' with a sense meaning random. The term ''stochastic process'' first appeared in English in a 1934 paper by
Joseph Doob Joseph Leo Doob (February 27, 1910 – June 7, 2004) was an American mathematician, specializing in analysis and probability theory. The theory of martingales was developed by Doob. Early life and education Doob was born in Cincinnati, Ohio, ...
. For the term and a specific mathematical definition, Doob cited another 1934 paper, where the term ''stochastischer Prozeß'' was used in German by
Aleksandr Khinchin Aleksandr Yakovlevich Khinchin (russian: Алекса́ндр Я́ковлевич Хи́нчин, french: Alexandre Khintchine; July 19, 1894 – November 18, 1959) was a Soviet mathematician and one of the most significant contributors to th ...
, though the German term had been used earlier in 1931 by Andrey Kolmogorov.


Mathematics

In the early 1930s, Aleksandr Khinchin gave the first mathematical definition of a stochastic process as a family of random variables indexed by the real line. Further fundamental work on probability theory and stochastic processes was done by Khinchin as well as other mathematicians such as Andrey Kolmogorov,
Joseph Doob Joseph Leo Doob (February 27, 1910 – June 7, 2004) was an American mathematician, specializing in analysis and probability theory. The theory of martingales was developed by Doob. Early life and education Doob was born in Cincinnati, Ohio, ...
, William Feller,
Maurice Fréchet Maurice may refer to: People *Saint Maurice (died 287), Roman legionary and Christian martyr *Maurice (emperor) or Flavius Mauricius Tiberius Augustus (539–602), Byzantine emperor *Maurice (bishop of London) (died 1107), Lord Chancellor and Lo ...
, Paul Lévy,
Wolfgang Doeblin Wolfgang Doeblin, known in France as Vincent Doblin (17 March 1915 – 21 June 1940), was a French-German mathematician. Life A native of Berlin, Wolfgang was the son of the Jewish-German novelist and physician, Alfred Döblin, and Erna Reiss. ...
, and
Harald Cramér Harald Cramér (; 25 September 1893 – 5 October 1985) was a Swedish mathematician, actuary, and statistician, specializing in mathematical statistics and probabilistic number theory. John Kingman described him as "one of the giants of statist ...
. Decades later Cramér referred to the 1930s as the "heroic period of mathematical probability theory". In mathematics, the theory of stochastic processes is an important contribution to probability theory, and continues to be an active topic of research for both theory and applications. The word ''stochastic'' is used to describe other terms and objects in mathematics. Examples include a stochastic matrix, which describes a stochastic process known as a Markov process, and stochastic calculus, which involves differential equations and integrals based on stochastic processes such as the Wiener process, also called the Brownian motion process.


Natural science

One of the simplest continuous-time stochastic processes is Brownian motion. This was first observed by botanist Robert Brown while looking through a microscope at pollen grains in water.


Physics

The Monte Carlo method is a stochastic method popularized by physics researchers Stanisław Ulam,
Enrico Fermi Enrico Fermi (; 29 September 1901 – 28 November 1954) was an Italian (later naturalized American) physicist and the creator of the world's first nuclear reactor, the Chicago Pile-1. He has been called the "architect of the nuclear age" and ...
, John von Neumann, and Nicholas Metropolis. The use of randomness and the repetitive nature of the process are analogous to the activities conducted at a casino. Methods of simulation and statistical sampling generally did the opposite: using simulation to test a previously understood deterministic problem. Though examples of an "inverted" approach do exist historically, they were not considered a general method until the popularity of the Monte Carlo method spread. Perhaps the most famous early use was by Enrico Fermi in 1930, when he used a random method to calculate the properties of the newly discovered neutron. Monte Carlo methods were central to the simulations required for the Manhattan Project, though they were severely limited by the computational tools of the time. Therefore, it was only after electronic computers were first built (from 1945 on) that Monte Carlo methods began to be studied in depth. In the 1950s they were used at Los Alamos for early work relating to the development of the
hydrogen bomb A thermonuclear weapon, fusion weapon or hydrogen bomb (H bomb) is a second-generation nuclear weapon design. Its greater sophistication affords it vastly greater destructive power than first-generation nuclear bombs, a more compact size, a lowe ...
, and became popularized in the fields of physics, physical chemistry, and operations research. The
RAND Corporation The RAND Corporation (from the phrase "research and development") is an American nonprofit global policy think tank created in 1948 by Douglas Aircraft Company to offer research and analysis to the United States Armed Forces. It is financed ...
and the U.S. Air Force were two of the major organizations responsible for funding and disseminating information on Monte Carlo methods during this time, and they began to find a wide application in many different fields. Uses of Monte Carlo methods require large amounts of random numbers, and it was their use that spurred the development of pseudorandom number generators, which were far quicker to use than the tables of random numbers which had been previously used for statistical sampling.


Biology

Stochastic resonance Stochastic resonance (SR) is a phenomenon in which a signal that is normally too weak to be detected by a sensor, can be boosted by adding white noise to the signal, which contains a wide spectrum of frequencies. The frequencies in the white no ...
: In biological systems, introducing stochastic "noise" has been found to help improve the signal strength of the internal feedback loops for balance and other vestibular communication. It has been found to help diabetic and stroke patients with balance control. Many biochemical events also lend themselves to stochastic analysis.
Gene expression Gene expression is the process by which information from a gene is used in the synthesis of a functional gene product that enables it to produce end products, protein or non-coding RNA, and ultimately affect a phenotype, as the final effect. The ...
, for example, has a stochastic component through the molecular collisions—as during binding and unbinding of
RNA polymerase In molecular biology, RNA polymerase (abbreviated RNAP or RNApol), or more specifically DNA-directed/dependent RNA polymerase (DdRP), is an enzyme that synthesizes RNA from a DNA template. Using the enzyme helicase, RNAP locally opens the ...
to a
gene promoter In genetics, a promoter is a sequence of DNA to which proteins bind to initiate transcription of a single RNA transcript from the DNA downstream of the promoter. The RNA transcript may encode a protein (mRNA), or can have a function in and of i ...
—via the solution's Brownian motion.


Creativity

Simonton (2003, ''Psych Bulletin'') argues that creativity in science (of scientists) is a constrained stochastic behaviour such that new theories in all sciences are, at least in part, the product of a
stochastic process In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
.


Computer science

Stochastic ray tracing Distributed ray tracing, also called distribution ray tracing and stochastic ray tracing, is a refinement of ray tracing that allows for the rendering of "soft" phenomena. Conventional ray tracing uses single rays to sample many different domain ...
is the application of
Monte Carlo simulation Monte Carlo methods, or Monte Carlo experiments, are a broad class of computational algorithms that rely on repeated random sampling to obtain numerical results. The underlying concept is to use randomness to solve problems that might be determini ...
to the computer graphics ray tracing algorithm. " Distributed ray tracing samples the integrand at many randomly chosen points and averages the results to obtain a better approximation. It is essentially an application of the Monte Carlo method to
3D computer graphics 3D computer graphics, or “3D graphics,” sometimes called CGI, 3D-CGI or three-dimensional computer graphics are graphics that use a three-dimensional representation of geometric data (often Cartesian) that is stored in the computer for th ...
, and for this reason is also called ''Stochastic ray tracing''." Stochastic forensics analyzes computer crime by viewing computers as stochastic processes. In artificial intelligence, stochastic programs work by using probabilistic methods to solve problems, as in simulated annealing,
stochastic neural network Artificial neural networks (ANNs), usually simply called neural networks (NNs) or neural nets, are computing systems inspired by the biological neural networks that constitute animal brains. An ANN is based on a collection of connected units ...
s,
stochastic optimization Stochastic optimization (SO) methods are optimization methods that generate and use random variables. For stochastic problems, the random variables appear in the formulation of the optimization problem itself, which involves random objective funct ...
,
genetic algorithm In computer science and operations research, a genetic algorithm (GA) is a metaheuristic inspired by the process of natural selection that belongs to the larger class of evolutionary algorithms (EA). Genetic algorithms are commonly used to gene ...
s, and genetic programming. A problem itself may be stochastic as well, as in planning under uncertainty.


Finance

The financial markets use stochastic models to represent the seemingly random behaviour of assets such as
stock In finance, stock (also capital stock) consists of all the shares by which ownership of a corporation or company is divided.Longman Business English Dictionary: "stock - ''especially AmE'' one of the shares into which ownership of a company ...
s,
commodities In economics, a commodity is an economic good, usually a resource, that has full or substantial fungibility: that is, the market treats instances of the good as equivalent or nearly so with no regard to who produced them. The price of a comm ...
, relative currency prices (i.e., the price of one currency compared to that of another, such as the price of US Dollar compared to that of the Euro), and interest rates. These models are then used by quantitative analysts to value options on stock prices, bond prices, and on interest rates, see Markov models. Moreover, it is at the heart of the insurance industry.


Geomorphology

The formation of river meanders has been analyzed as a stochastic process.


Language and linguistics

Non-deterministic approaches in language studies are largely inspired by the work of
Ferdinand de Saussure Ferdinand de Saussure (; ; 26 November 1857 – 22 February 1913) was a Swiss linguist, semiotician and philosopher. His ideas laid a foundation for many significant developments in both linguistics and semiotics in the 20th century. He is widel ...
, for example, in functionalist linguistic theory, which argues that
competence Competence may refer to: *Competence (geology), the resistance of a rock against deformation or plastic flow. *Competence (human resources), a standardized requirement for an individual to properly perform a specific job *Competence (law), the me ...
is based on
performance A performance is an act of staging or presenting a play, concert, or other form of entertainment. It is also defined as the action or process of carrying out or accomplishing an action, task, or function. Management science In the work place ...
. This distinction in functional theories of grammar should be carefully distinguished from the ''langue'' and ''parole'' distinction. To the extent that linguistic knowledge is constituted by experience with language, grammar is argued to be probabilistic and variable rather than fixed and absolute. This conception of grammar as probabilistic and variable follows from the idea that one's competence changes in accordance with one's experience with language. Though this conception has been contested, it has also provided the foundation for modern statistical natural language processing and for theories of language learning and change.


Manufacturing

Manufacturing processes are assumed to be
stochastic process In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...
es. This assumption is largely valid for either continuous or batch manufacturing processes. Testing and monitoring of the process is recorded using a
process control An industrial process control in continuous production processes is a discipline that uses industrial control systems to achieve a production level of consistency, economy and safety which could not be achieved purely by human manual control. I ...
chart which plots a given process control parameter over time. Typically a dozen or many more parameters will be tracked simultaneously. Statistical models are used to define limit lines which define when corrective actions must be taken to bring the process back to its intended operational window. This same approach is used in the service industry where parameters are replaced by processes related to service level agreements.


Media

The marketing and the changing movement of audience tastes and preferences, as well as the solicitation of and the scientific appeal of certain film and television debuts (i.e., their opening weekends, word-of-mouth, top-of-mind knowledge among surveyed groups, star name recognition and other elements of social media outreach and advertising), are determined in part by stochastic modeling. A recent attempt at repeat business analysis was done by Japanese scholars and is part of the Cinematic Contagion Systems patented by Geneva Media Holdings, and such modeling has been used in data collection from the time of the original
Nielsen ratings Nielsen Media Research (NMR) is an American firm that measures media audiences, including television, radio, theatre, films (via the AMC Theatres MAP program), and newspapers. Headquartered in New York City, it is best known for the Nielsen rat ...
to modern studio and television test audiences.


Medicine

Stochastic effect, or "chance effect" is one classification of radiation effects that refers to the random, statistical nature of the damage. In contrast to the deterministic effect, severity is independent of dose. Only the ''probability'' of an effect increases with dose.


Music

In music, mathematical processes based on probability can generate stochastic elements. Stochastic processes may be used in music to compose a fixed piece or may be produced in performance. Stochastic music was pioneered by Iannis Xenakis, who coined the term ''stochastic music''. Specific examples of mathematics, statistics, and physics applied to music composition are the use of the
statistical mechanics In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. It does not assume or postulate any natural laws, but explains the macroscopic be ...
of gases in '' Pithoprakta'',
statistical distribution In statistics, an empirical distribution function (commonly also called an empirical Cumulative Distribution Function, eCDF) is the distribution function associated with the empirical measure of a sample. This cumulative distribution functio ...
of points on a plane in ''
Diamorphoses ''Diamorphoses'' ( gr, Διαμορφώσεις) is the first electroacoustic composition by Greek composer Iannis Xenakis. It was created between 1957 and 1958 and is considered a masterpiece in several academic books on history of electroacoustic ...
'', minimal constraints in ''Achorripsis'', the
normal distribution In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is : f(x) = \frac e^ The parameter \mu ...
in ''ST/10'' and ''Atrées'',
Markov chain A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happe ...
s in ''Analogiques'',
game theory Game theory is the study of mathematical models of strategic interactions among rational agents. Myerson, Roger B. (1991). ''Game Theory: Analysis of Conflict,'' Harvard University Press, p.&nbs1 Chapter-preview links, ppvii–xi It has appli ...
in ''Duel'' and ''Stratégie'', group theory in ''
Nomos Alpha ''Nomos Alpha'' ( el, Νόμος α΄) is a piece for solo cello composed by Iannis Xenakis in 1965, commissioned by Radio Bremen for cellist Siegfried Palm, and dedicated to mathematicians Aristoxenus of Tarentum, Évariste Galois, and Felix Kl ...
'' (for
Siegfried Palm Siegfried Palm (25 April 1927 – 6 June 2005) was a German cellist who is known worldwide for his interpretations of contemporary music. Many 20th-century composers like Kagel, Ligeti, Xenakis, Penderecki and Zimmermann wrote music for ...
), set theory in ''Herma'' and ''
Eonta ''Eonta'' is a composition for piano, two trumpets, and three tenor trombones by Iannis Xenakis. It was written in 1963–64, and was premiered on December 16, 1964, by the Ensemble du Domaine Musical, with Yuji Takahashi on piano and Pierre Bou ...
'', and Brownian motion in ''N'Shima''. Xenakis frequently used
computers A computer is a machine that can be programmed to carry out sequences of arithmetic or logical operations (computation) automatically. Modern digital electronic computers can perform generic sets of operations known as programs. These programs ...
to produce his scores, such as the ''ST'' series including ''Morsima-Amorsima'' and ''Atrées'', and founded
CEMAMu CCMIX (Center for the Composition of Music Iannis Xenakis, 2000), formerly Les Ateliers UPIC PIC workshops CEMAMu (Centre d'Etudes de Mathématique et Automatique Musicales, 1972), and EMAMu (Equipe de Mathématique et Automatique Musicales), was a ...
. Earlier,
John Cage John Milton Cage Jr. (September 5, 1912 – August 12, 1992) was an American composer and music theorist. A pioneer of indeterminacy in music, electroacoustic music, and non-standard use of musical instruments, Cage was one of the leading fi ...
and others had composed ''
aleatoric Aleatoricism or aleatorism, the noun associated with the adjectival aleatory and aleatoric, is a term popularised by the musical composer Pierre Boulez, but also Witold Lutosławski and Franco Evangelisti, for compositions resulting from "action ...
'' or
indeterminate music Indeterminacy is a composing approach in which some aspects of a musical work are left open to chance or to the interpreter's free choice. John Cage, a pioneer of indeterminacy, defined it as "the ability of a piece to be performed in substantially ...
, which is created by chance processes but does not have the strict mathematical basis (Cage's '' Music of Changes'', for example, uses a system of charts based on the ''
I-Ching The ''I Ching'' or ''Yi Jing'' (, ), usually translated ''Book of Changes'' or ''Classic of Changes'', is an ancient Chinese divination text that is among the oldest of the Chinese classics. Originally a divination manual in the Western Zhou ...
'').
Lejaren Hiller Lejaren Arthur Hiller Jr. (February 23, 1924, New York City – January 26, 1994, Buffalo, New York)Lejaren Hi ...
and
Leonard Issacson Leonard Maxwell Isaacson (born 1925) is an American chemist and composer. Isaacson collaborated with Lejaren Hiller on the computer-programmed acoustic composition, ''Illiac Suite'' (1957).
used generative grammars and
Markov chain A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happe ...
s in their 1957 ''
Illiac Suite ''Illiac Suite'' (later retitled String Quartet No. 4)Andrew Stiller, "Hiller, Lejaren (Arthur)", ''Grove Music Online'' (reviewed December 3, 2010; accessed December 14, 2014). is a 1957 composition for string quartet which is generally agreed to ...
''. Modern electronic music production techniques make these processes relatively simple to implement, and many hardware devices such as synthesizers and drum machines incorporate randomization features. Generative music techniques are therefore readily accessible to composers, performers, and producers.


Social sciences

Stochastic social science theory is similar to systems theory in that events are interactions of systems, although with a marked emphasis on unconscious processes. The event creates its own conditions of possibility, rendering it unpredictable if simply for the number of variables involved. Stochastic social science theory can be seen as an elaboration of a kind of 'third axis' in which to situate human behavior alongside the traditional 'nature vs. nurture' opposition. See
Julia Kristeva Julia Kristeva (; born Yuliya Stoyanova Krasteva, bg, Юлия Стоянова Кръстева; on 24 June 1941) is a Bulgarian-French philosopher, literary critic, semiotician, psychoanalyst, feminist, and, most recently, novelist, who has ...
on her usage of the 'semiotic',
Luce Irigaray Luce Irigaray (born 3 May 1930) is a Belgian-born French feminist, philosopher, linguist, psycholinguist, psychoanalyst, and cultural theorist who examined the uses and misuses of language in relation to women. Irigaray's first and most well know ...
on reverse Heideggerian epistemology, and Pierre Bourdieu on polythetic space for examples of stochastic social science theory. The term "Stochastic Terrorism" has fallen into frequent use published August 12, 2019 CNN with regard to
lone wolf terrorism A lone wolf attack, or lone actor attack, is a particular kind of mass murder, committed in a public setting by an individual who plans and commits the act on their own. In the United States, such attacks are usually committed with firearms. I ...
. The terms "Scripted Violence" and "Stochastic Terrorism" are linked in a "cause <> effect" relationship. "Scripted Violence" rhetoric can result in an act of "Stochastic Terrorism." The phrase "scripted violence" has been used in social science since at least 2002. Author David Neiwert, who wrote the book ''
Alt-America ''Alt-America: The Rise of the Radical Right in the Age of Trump'' is a 2017 nonfiction book by investigative journalist David Neiwert in which provides an account of how disparate but interrelated elements of American culture ranging from the B ...
'', told Salon interviewer Chauncey Devega:


Subtractive color reproduction

When color reproductions are made, the image is separated into its component colors by taking multiple photographs filtered for each color. One resultant film or plate represents each of the cyan, magenta, yellow, and black data.
Color printing Color printing or colour printing is the reproduction of an image or text in color (as opposed to simpler black and white or monochrome printing). Any natural scene or color photograph can be optically and physiologically dissected into three ...
is a binary system, where ink is either present or not present, so all color separations to be printed must be translated into dots at some stage of the work-flow. Traditional line screens which are
amplitude modulated Amplitude modulation (AM) is a modulation technique used in electronic communication, most commonly for transmitting messages with a radio wave. In amplitude modulation, the amplitude (signal strength) of the wave is varied in proportion to t ...
had problems with moiré but were used until stochastic screening became available. A stochastic (or frequency modulated) dot pattern creates a sharper image.


See also

* Jump process * Sortition *
Stochastic process In probability theory and related fields, a stochastic () or random process is a mathematical object usually defined as a family of random variables. Stochastic processes are widely used as mathematical models of systems and phenomena that appea ...


Notes


References


Further reading

* ''Formalized Music: Thought and Mathematics in Composition'' by Iannis Xenakis, * ''Frequency and the Emergence of Linguistic Structure'' by Joan Bybee and Paul Hopper (eds.), / (Eur.) * The
Stochastic Empirical Loading and Dilution Model Stochastic (, ) refers to the property of being well described by a random probability distribution. Although stochasticity and randomness are distinct in that the former refers to a modeling approach and the latter refers to phenomena themselve ...
provides documentation and computer code for modeling stochastic processes in Visual Basic for Applications.


External links

* {{Authority control * Mathematical terminology