Fourier analysis
   HOME

TheInfoList



OR:

In
mathematics Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
, Fourier analysis () is the study of the way general functions may be represented or approximated by sums of simpler trigonometric functions. Fourier analysis grew from the study of Fourier series, and is named after Joseph Fourier, who showed that representing a function as a sum of trigonometric functions greatly simplifies the study of heat transfer. The subject of Fourier analysis encompasses a vast spectrum of mathematics. In the sciences and engineering, the process of decomposing a function into oscillatory components is often called Fourier analysis, while the operation of rebuilding the function from these pieces is known as Fourier synthesis. For example, determining what component
frequencies Frequency is the number of occurrences of a repeating event per unit of time. It is also occasionally referred to as ''temporal frequency'' for clarity, and is distinct from ''angular frequency''. Frequency is measured in Hertz (unit), hertz (H ...
are present in a musical note would involve computing the Fourier transform of a sampled musical note. One could then re-synthesize the same sound by including the frequency components as revealed in the Fourier analysis. In mathematics, the term ''Fourier analysis'' often refers to the study of both operations. The decomposition process itself is called a Fourier transformation. Its output, the Fourier transform, is often given a more specific name, which depends on the domain and other properties of the function being transformed. Moreover, the original concept of Fourier analysis has been extended over time to apply to more and more abstract and general situations, and the general field is often known as harmonic analysis. Each transform used for analysis (see list of Fourier-related transforms) has a corresponding inverse transform that can be used for synthesis. To use Fourier analysis, data must be equally spaced. Different approaches have been developed for analyzing unequally spaced data, notably the least-squares spectral analysis (LSSA) methods that use a least squares fit of sinusoids to data samples, similar to Fourier analysis. Fourier analysis, the most used spectral method in science, generally boosts long-periodic noise in long gapped records; LSSA mitigates such problems.


Applications

Fourier analysis has many scientific applications – in
physics Physics is the natural science that studies matter, its Elementary particle, fundamental constituents, its motion and behavior through Spacetime, space and time, and the related entities of energy and force. "Physical science is that depar ...
, partial differential equations,
number theory Number theory (or arithmetic or higher arithmetic in older usage) is a branch of pure mathematics devoted primarily to the study of the integer An integer is the number zero (), a positive natural number (, , , etc.) or a negative intege ...
,
combinatorics Combinatorics is an area of mathematics primarily concerned with counting, both as a means and an end in obtaining results, and certain properties of finite set, finite Mathematical structure, structures. It is closely related to many other ar ...
, signal processing, digital image processing, probability theory,
statistics Statistics (from German language, German: ''wikt:Statistik#German, Statistik'', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of ...
, forensics, option pricing, cryptography, numerical analysis,
acoustics Acoustics is a branch of physics that deals with the study of mechanical waves in gases, liquids, and solids including topics such as vibration, sound, ultrasound and infrasound. A scientist who works in the field of acoustics is an acoustician ...
, oceanography,
sonar Sonar (sound navigation and ranging or sonic navigation and ranging) is a technique that uses sound propagation (usually underwater, as in submarine navigation) to navigation, navigate, measure distances (ranging), communicate with or detect o ...
, optics, diffraction,
geometry Geometry (; ) is, with arithmetic, one of the oldest branches of mathematics. It is concerned with properties of space such as the distance, shape, size, and relative position of figures. A mathematician who works in the field of geometry is ca ...
,
protein Proteins are large biomolecules and macromolecules that comprise one or more long chains of amino acid residue (biochemistry), residues. Proteins perform a vast array of functions within organisms, including Enzyme catalysis, catalysing metabo ...
structure analysis, and other areas. This wide applicability stems from many useful properties of the transforms: * The transforms are linear operators and, with proper normalization, are unitary as well (a property known as Parseval's theorem or, more generally, as the Plancherel theorem, and most generally via Pontryagin duality). * The transforms are usually invertible. * The exponential functions are eigenfunctions of differentiation, which means that this representation transforms linear differential equations with constant coefficients into ordinary algebraic ones. Therefore, the behavior of a linear time-invariant system can be analyzed at each frequency independently. * By the convolution theorem, Fourier transforms turn the complicated convolution operation into simple multiplication, which means that they provide an efficient way to compute convolution-based operations such as signal filtering, polynomial multiplication, and multiplying large numbers. * The discrete version of the Fourier transform (see below) can be evaluated quickly on computers using fast Fourier transform (FFT) algorithms. In forensics, laboratory infrared spectrophotometers use Fourier transform analysis for measuring the wavelengths of light at which a material will absorb in the infrared spectrum. The FT method is used to decode the measured signals and record the wavelength data. And by using a computer, these Fourier calculations are rapidly carried out, so that in a matter of seconds, a computer-operated FT-IR instrument can produce an infrared absorption pattern comparable to that of a prism instrument. Fourier transformation is also useful as a compact representation of a signal. For example, JPEG compression uses a variant of the Fourier transformation ( discrete cosine transform) of small square pieces of a digital image. The Fourier components of each square are rounded to lower arithmetic precision, and weak components are eliminated entirely, so that the remaining components can be stored very compactly. In image reconstruction, each image square is reassembled from the preserved approximate Fourier-transformed components, which are then inverse-transformed to produce an approximation of the original image. In signal processing, the Fourier transform often takes a time series or a function of continuous time, and maps it into a frequency spectrum. That is, it takes a function from the time domain into the
frequency Frequency is the number of occurrences of a repeating event per unit of time. It is also occasionally referred to as ''temporal frequency'' for clarity, and is distinct from ''angular frequency''. Frequency is measured in Hertz (unit), hertz (H ...
domain; it is a decomposition of a function into sinusoids of different frequencies; in the case of a Fourier series or discrete Fourier transform, the sinusoids are harmonics of the fundamental frequency of the function being analyzed. When a function s(t) is a function of time and represents a physical signal, the transform has a standard interpretation as the frequency spectrum of the signal. The magnitude of the resulting complex-valued function S(f) at frequency f represents the amplitude of a frequency component whose initial phase is given by the angle of S(f) (polar coordinates). Fourier transforms are not limited to functions of time, and temporal frequencies. They can equally be applied to analyze ''spatial'' frequencies, and indeed for nearly any function domain. This justifies their use in such diverse branches as
image processing An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
, heat conduction, and automatic control. When processing signals, such as audio, radio waves, light waves, seismic waves, and even images, Fourier analysis can isolate narrowband components of a compound waveform, concentrating them for easier detection or removal. A large family of signal processing techniques consist of Fourier-transforming a signal, manipulating the Fourier-transformed data in a simple way, and reversing the transformation. Some examples include: * Equalization of audio recordings with a series of bandpass filters; * Digital radio reception without a superheterodyne circuit, as in a modern cell phone or radio scanner; *
Image processing An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
to remove periodic or anisotropic artifacts such as jaggies from
interlaced video Interlaced video (also known as interlaced scan) is a technique for doubling the perceived frame rate of a video display without consuming extra Bandwidth (signal processing), bandwidth. The interlaced signal contains two field (video), fields ...
, strip artifacts from strip aerial photography, or wave patterns from radio frequency interference in a digital camera; * Cross correlation of similar images for co-alignment; *
X-ray crystallography X-ray crystallography is the experimental science determining the atomic and molecular structure of a crystal, in which the crystalline structure causes a beam of incident X-rays to Diffraction, diffract into many specific directions. By measurin ...
to reconstruct a crystal structure from its diffraction pattern; * Fourier-transform ion cyclotron resonance mass spectrometry to determine the mass of ions from the frequency of cyclotron motion in a magnetic field; * Many other forms of spectroscopy, including infrared and
nuclear magnetic resonance Nuclear magnetic resonance (NMR) is a physical phenomenon in which atomic nucleus, nuclei in a strong constant magnetic field are perturbed by a weak oscillating magnetic field (in the near and far field, near field) and respond by producing ...
spectroscopies; * Generation of sound spectrograms used to analyze sounds; * Passive
sonar Sonar (sound navigation and ranging or sonic navigation and ranging) is a technique that uses sound propagation (usually underwater, as in submarine navigation) to navigation, navigate, measure distances (ranging), communicate with or detect o ...
used to classify targets based on machinery noise.


Variants of Fourier analysis


(Continuous) Fourier transform

Most often, the unqualified term Fourier transform refers to the transform of functions of a continuous real argument, and it produces a continuous function of frequency, known as a ''frequency distribution''. One function is transformed into another, and the operation is reversible. When the domain of the input (initial) function is time (), and the domain of the output (final) function is ordinary frequency, the transform of function at frequency is given by the complex number: :S(f) = \int_^ s(t) \cdot e^ \, dt. Evaluating this quantity for all values of produces the ''frequency-domain'' function. Then can be represented as a recombination of complex exponentials of all possible frequencies: :s(t) = \int_^ S(f) \cdot e^ \, df, which is the inverse transform formula. The complex number, , conveys both amplitude and phase of frequency . See Fourier transform for much more information, including: * conventions for amplitude normalization and frequency scaling/units * transform properties * tabulated transforms of specific functions * an extension/generalization for functions of multiple dimensions, such as images.


Fourier series

The Fourier transform of a periodic function, , with period , becomes a Dirac comb function, modulated by a sequence of complex coefficients: :S = \frac\int_ s_P(t)\cdot e^\, dt, \quad k\in\Z,     (where is the integral over any interval of length ''P''). The inverse transform, known as Fourier series, is a representation of in terms of a summation of a potentially infinite number of harmonically related sinusoids or complex exponential functions, each with an amplitude and phase specified by one of the coefficients: :s_P(t)\ \ =\ \ \mathcal^\left\\ \ =\ \ \sum_^\infty S cdot e^. Any can be expressed as a periodic summation of another function, : :s_P(t) \,\triangleq\, \sum_^\infty s(t-mP), and the coefficients are proportional to samples of at discrete intervals of : :S =\frac\cdot S\left(\frac\right). Note that any whose transform has the same discrete sample values can be used in the periodic summation. A sufficient condition for recovering (and therefore ) from just these samples (i.e. from the Fourier series) is that the non-zero portion of be confined to a known interval of duration , which is the frequency domain dual of the Nyquist–Shannon sampling theorem. See Fourier series for more information, including the historical development.


Discrete-time Fourier transform (DTFT)

The DTFT is the mathematical dual of the time-domain Fourier series. Thus, a convergent periodic summation in the frequency domain can be represented by a Fourier series, whose coefficients are samples of a related continuous time function: :S_\frac(f)\ \triangleq\ \underbrace_ = \mathcal \left \,\, which is known as the DTFT. Thus the DTFT of the sequence is also the Fourier transform of the modulated Dirac comb function. The Fourier series coefficients (and inverse transform), are defined by: :s \triangleq\ T \int_\frac S_\frac(f)\cdot e^ \,df = T \underbrace_. Parameter corresponds to the sampling interval, and this Fourier series can now be recognized as a form of the Poisson summation formula.  Thus we have the important result that when a discrete data sequence, , is proportional to samples of an underlying continuous function, , one can observe a periodic summation of the continuous Fourier transform, . Note that any with the same discrete sample values produces the same DTFT  But under certain idealized conditions one can theoretically recover and exactly. A sufficient condition for perfect recovery is that the non-zero portion of be confined to a known frequency interval of width .  When that interval is , the applicable reconstruction formula is the Whittaker–Shannon interpolation formula. This is a cornerstone in the foundation of digital signal processing. Another reason to be interested in is that it often provides insight into the amount of aliasing caused by the sampling process. Applications of the DTFT are not limited to sampled functions. See Discrete-time Fourier transform for more information on this and other topics, including: * normalized frequency units * windowing (finite-length sequences) * transform properties * tabulated transforms of specific functions


Discrete Fourier transform (DFT)

Similar to a Fourier series, the DTFT of a periodic sequence, s_N /math>, with period N, becomes a Dirac comb function, modulated by a sequence of complex coefficients (see ): :S = \sum_n s_N cdot e^, \quad k\in\Z,     (where is the sum over any sequence of length ). The sequence is what is customarily known as the DFT of one cycle of . It is also -periodic, so it is never necessary to compute more than coefficients. The inverse transform, also known as a discrete Fourier series, is given by: :s_N = \frac \sum_ S cdot e^,   where is the sum over any sequence of length . When is expressed as a periodic summation of another function: :s_N , \triangleq\, \sum_^ s -mN   and   s , \triangleq\, s(nT), the coefficients are proportional to samples of at disrete intervals of : :S = \frac\cdot S_\frac\left(\frac\right). Conversely, when one wants to compute an arbitrary number () of discrete samples of one cycle of a continuous DTFT, , it can be done by computing the relatively simple DFT of , as defined above. In most cases, is chosen equal to the length of non-zero portion of . Increasing , known as ''zero-padding'' or ''interpolation'', results in more closely spaced samples of one cycle of . Decreasing , causes overlap (adding) in the time-domain (analogous to aliasing), which corresponds to decimation in the frequency domain. (see ) In most cases of practical interest, the sequence represents a longer sequence that was truncated by the application of a finite-length window function or FIR filter array. The DFT can be computed using a fast Fourier transform (FFT) algorithm, which makes it a practical and important transformation on computers. See Discrete Fourier transform for much more information, including: * transform properties * applications * tabulated transforms of specific functions


Summary

For periodic functions, both the Fourier transform and the DTFT comprise only a discrete set of frequency components (Fourier series), and the transforms diverge at those frequencies. One common practice (not discussed above) is to handle that divergence via Dirac delta and Dirac comb functions. But the same spectral information can be discerned from just one cycle of the periodic function, since all the other cycles are identical. Similarly, finite-duration functions can be represented as a Fourier series, with no actual loss of information except that the periodicity of the inverse transform is a mere artifact. It is common in practice for the duration of ''s''(•) to be limited to the period, or .  But these formulas do not require that condition.


Symmetry properties

When the real and imaginary parts of a complex function are decomposed into their even and odd parts, there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform: : \begin \text & s & = & s_ & + & s_ & + & i s_ & + & \underbrace \\ &\Bigg\Updownarrow\mathcal & &\Bigg\Updownarrow\mathcal & &\ \ \Bigg\Updownarrow\mathcal & &\ \ \Bigg\Updownarrow\mathcal & &\ \ \Bigg\Updownarrow\mathcal\\ \text & S & = & S_\text & + & \overbrace & + & i S_\text & + & S_\text \end From this, various relationships are apparent, for example: *The transform of a real-valued function () is the even symmetric function . Conversely, an even-symmetric transform implies a real-valued time-domain. *The transform of an imaginary-valued function () is the odd symmetric function , and the converse is true. *The transform of an even-symmetric function () is the real-valued function , and the converse is true. *The transform of an odd-symmetric function () is the imaginary-valued function , and the converse is true.


History

An early form of harmonic series dates back to ancient Babylonian mathematics, where they were used to compute ephemerides (tables of astronomical positions). The Classical Greek concepts of deferent and epicycle in the Ptolemaic system of astronomy were related to Fourier series (see ). In modern times, variants of the discrete Fourier transform were used by Alexis Clairaut in 1754 to compute an orbit, which has been described as the first formula for the DFT, and in 1759 by Joseph Louis Lagrange, in computing the coefficients of a trigonometric series for a vibrating string. Technically, Clairaut's work was a cosine-only series (a form of discrete cosine transform), while Lagrange's work was a sine-only series (a form of discrete sine transform); a true cosine+sine DFT was used by Gauss in 1805 for trigonometric interpolation of
asteroid An asteroid is a minor planet of the inner Solar System. Sizes and shapes of asteroids vary significantly, ranging from 1-meter rocks to a dwarf planet almost 1000 km in diameter; they are rocky, metallic or icy bodies with no atmosphere ...
orbits. Euler and Lagrange both discretized the vibrating string problem, using what would today be called samples. An early modern development toward Fourier analysis was the 1770 paper '' Réflexions sur la résolution algébrique des équations'' by Lagrange, which in the method of Lagrange resolvents used a complex Fourier decomposition to study the solution of a cubic: Lagrange transformed the roots into the resolvents: :\begin r_1 &= x_1 + x_2 + x_3\\ r_2 &= x_1 + \zeta x_2 + \zeta^2 x_3\\ r_3 &= x_1 + \zeta^2 x_2 + \zeta x_3 \end where is a cubic root of unity, which is the DFT of order 3. A number of authors, notably Jean le Rond d'Alembert, and Carl Friedrich Gauss used trigonometric series to study the heat equation, but the breakthrough development was the 1807 paper '' Mémoire sur la propagation de la chaleur dans les corps solides'' by Joseph Fourier, whose crucial insight was to model ''all'' functions by trigonometric series, introducing the Fourier series. Historians are divided as to how much to credit Lagrange and others for the development of Fourier theory: Daniel Bernoulli and
Leonhard Euler Leonhard Euler ( , ; 15 April 170718 September 1783) was a Swiss mathematician, physicist, astronomer, geographer, logician and engineer who founded the studies of graph theory and topology and made pioneering and influential discoveries in ma ...
had introduced trigonometric representations of functions, and Lagrange had given the Fourier series solution to the wave equation, so Fourier's contribution was mainly the bold claim that an arbitrary function could be represented by a Fourier series. The subsequent development of the field is known as harmonic analysis, and is also an early instance of representation theory. The first fast Fourier transform (FFT) algorithm for the DFT was discovered around 1805 by Carl Friedrich Gauss when interpolating measurements of the orbit of the asteroids Juno and Pallas, although that particular FFT algorithm is more often attributed to its modern rediscoverers Cooley and Tukey.


Time–frequency transforms

In signal processing terms, a function (of time) is a representation of a signal with perfect ''time resolution'', but no frequency information, while the Fourier transform has perfect ''frequency resolution'', but no time information. As alternatives to the Fourier transform, in time–frequency analysis, one uses time–frequency transforms to represent signals in a form that has some time information and some frequency information – by the uncertainty principle, there is a trade-off between these. These can be generalizations of the Fourier transform, such as the short-time Fourier transform, the Gabor transform or fractional Fourier transform (FRFT), or can use different functions to represent signals, as in wavelet transforms and chirplet transforms, with the wavelet analog of the (continuous) Fourier transform being the continuous wavelet transform.


Fourier transforms on arbitrary locally compact abelian topological groups

The Fourier variants can also be generalized to Fourier transforms on arbitrary locally compact Abelian topological groups, which are studied in harmonic analysis; there, the Fourier transform takes functions on a group to functions on the dual group. This treatment also allows a general formulation of the convolution theorem, which relates Fourier transforms and convolutions. See also the Pontryagin duality for the generalized underpinnings of the Fourier transform. More specific, Fourier analysis can be done on cosets, even discrete cosets.


See also

* Conjugate Fourier series * Generalized Fourier series * Fourier–Bessel series * Fourier-related transforms * Laplace transform (LT) * Two-sided Laplace transform * Mellin transform * Non-uniform discrete Fourier transform (NDFT) * Quantum Fourier transform (QFT) * Number-theoretic transform * Basis vectors * Bispectrum * Characteristic function (probability theory) * Orthogonal functions * Schwartz space * Spectral density * Spectral density estimation * Spectral music * Walsh function * Wavelet


Notes


References


Further reading

* * * * * *


External links


Tables of Integral Transforms
at EqWorld: The World of Mathematical Equations.

by Steven Lehar.
Lectures on Image Processing: A collection of 18 lectures in pdf format from Vanderbilt University. Lecture 6 is on the 1- and 2-D Fourier Transform. Lectures 7–15 make use of it.
by Alan Peters * {{Authority control Integral transforms Digital signal processing Mathematical physics Mathematics of computing Time series Joseph Fourier Acoustics