Image analysis or imagery analysis is the extraction of meaningful information from
image
An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
s; mainly from
digital image
A digital image is an image composed of picture elements, also known as ''pixels'', each with ''finite'', '' discrete quantities'' of numeric representation for its intensity or gray level that is an output from its two-dimensional functions ...
s by means of
digital image processing techniques.
Image analysis tasks can be as simple as reading
bar coded tags or as sophisticated as
identifying a person from their face.
Computer
A computer is a machine that can be programmed to Execution (computing), carry out sequences of arithmetic or logical operations (computation) automatically. Modern digital electronic computers can perform generic sets of operations known as C ...
s are indispensable for the analysis of large amounts of data, for tasks that require complex computation, or for the extraction of quantitative information. On the other hand, the human
visual cortex is an excellent image analysis apparatus, especially for extracting higher-level information, and for many applications — including medicine, security, and remote sensing — human analysts still cannot be replaced by computers. For this reason, many important image analysis tools such as
edge detectors and
neural networks
A neural network is a network or circuit of biological neurons, or, in a modern sense, an artificial neural network, composed of artificial neurons or nodes. Thus, a neural network is either a biological neural network, made up of biological ...
are inspired by human
visual perception models.
Digital
Digital Image Analysis or Computer Image Analysis is when a computer or electrical device automatically studies an image to obtain useful information from it. Note that the device is often a computer but may also be an electrical circuit, a digital camera or a mobile phone.
It involves the fields of
computer
A computer is a machine that can be programmed to Execution (computing), carry out sequences of arithmetic or logical operations (computation) automatically. Modern digital electronic computers can perform generic sets of operations known as C ...
or
machine vision, and
medical imaging
Medical imaging is the technique and process of imaging the interior of a body for clinical analysis and medical intervention, as well as visual representation of the function of some organs or tissues (physiology). Medical imaging seeks to rev ...
, and makes heavy use of
pattern recognition,
digital geometry, and
signal processing. This field of
computer science developed in the 1950s at academic institutions such as the
MIT A.I. Lab, originally as a branch of
artificial intelligence and
robotics.
It is the
quantitative or
qualitative
Qualitative descriptions or distinctions are based on some quality or characteristic rather than on some quantity or measured value.
Qualitative may also refer to:
*Qualitative property, a property that can be observed but not measured numericall ...
characterization of
two-dimensional (2D) or
three-dimensional (3D)
digital images
A digital image is an image composed of picture elements, also known as ''pixels'', each with ''finite'', '' discrete quantities'' of numeric representation for its intensity or gray level that is an output from its two-dimensional functions f ...
. 2D images are, for example, to be analyzed in
computer vision
Computer vision is an interdisciplinary scientific field that deals with how computers can gain high-level understanding from digital images or videos. From the perspective of engineering, it seeks to understand and automate tasks that the hum ...
, and 3D images in
medical imaging
Medical imaging is the technique and process of imaging the interior of a body for clinical analysis and medical intervention, as well as visual representation of the function of some organs or tissues (physiology). Medical imaging seeks to rev ...
. The field was established in the 1950sā1970s, for example with pioneering contributions by
Azriel Rosenfeld,
Herbert Freeman,
Jack E. Bresenham, or
King-Sun Fu.
Techniques
There are many different techniques used in automatically analysing images. Each technique may be useful for a small range of tasks, however there still aren't any known methods of image analysis that are generic enough for wide ranges of tasks, compared to the abilities of a human's image analysing capabilities. Examples of image analysis techniques in different fields include:
* 2D and 3D
object recognition,
*
image segmentation,
*
motion detection
Motion detection is the process of detecting a change in the position of an object relative to its surroundings or a change in the surroundings relative to an object. It can be achieved by either mechanical or electronic methods. When it is done by ...
e.g.
Single particle tracking,
*
video tracking,
*
optical flow,
*
medical scan analysis,
*
3D Pose Estimation
3D pose estimation is a process of predicting the transformation of an object from a user-defined reference pose, given an image or a 3D scan. It arises in computer vision or robotics where the pose or transformation of an object can be used for ...
.
Applications
The applications of digital image analysis are continuously expanding through all areas of science and industry, including:
*
assay micro plate reading, such as detecting where a chemical was manufactured.
*
astronomy, such as calculating the size of a planet.
*
automated species identification (e.g. plant and animal species)
*
defense
Defense or defence may refer to:
Tactical, martial, and political acts or groups
* Defense (military), forces primarily intended for warfare
* Civil defense, the organizing of civilians to deal with emergencies or enemy attacks
* Defense industr ...
*
error level analysis
*
filtering
*
machine vision, such as to automatically count items in a factory conveyor belt.
*
materials science, such as determining if a metal weld has cracks.
*
medicine, such as detecting cancer in a mammography scan.
*
metallography, such as determining the mineral content of a rock sample.
*
microscopy
Microscopy is the technical field of using microscopes to view objects and areas of objects that cannot be seen with the naked eye (objects that are not within the resolution range of the normal eye). There are three well-known branches of micr ...
, such as counting the germs in a swab.
*
automatic number plate recognition;
*
optical character recognition, such as automatic license plate detection.
*
remote sensing, such as detecting intruders in a house, and producing land cover/land use maps.
*
robotics, such as to avoid steering into an obstacle.
*
security
Security is protection from, or resilience against, potential harm (or other unwanted coercive change) caused by others, by restraining the freedom of others to act. Beneficiaries (technically referents) of security may be of persons and social ...
, such as detecting a person's eye color or hair color.
Object-based

Object-based image analysis (OBIA) employs two main processes, segmentation and classification. Traditional image segmentation is on a per-pixel basis. However, OBIA groups pixels into homogeneous objects. These objects can have different shapes and scale. Objects also have statistics associated with them which can be used to classify objects. Statistics can include geometry, context and texture of image objects. The analyst defines statistics in the classification process to generate for example
land cover
Land cover is the physical material at the surface of Earth. Land covers include grass, asphalt, trees, bare ground, water, etc. Earth cover is the expression used by ecologist Frederick Edward Clements that has its closest modern equivalent being ...
.
When applied to
earth images, OBIA is known as ''geographic object-based image analysis'' (GEOBIA), defined as "a sub-discipline of
geoinformation science devoted to (...) partitioning
remote sensing (RS) imagery into meaningful image-objects, and assessing their characteristics through spatial, spectral and temporal scale".
The international GEOBIA conference has been held biannually since 2006.
Object-based image analysis is also applied in other fields, such as cell biology or medicine. It can for instance detect changes of cellular shapes in the process of cell differentiation.
The technique is implemented in software such as
eCognition or the
Orfeo toolbox.
See also
*
Archeological imagery
Remote sensing techniques in archaeology are an increasingly important component of the technical and methodological tool set available in archaeological research.Rindfuss, Ronald R and Stern, Paul C. Linking Remote Sensing and Social Science: Th ...
*
Imaging technologies
Imaging is the representation or reproduction of an object's form; especially a visual representation (i.e., the formation of an image).
Imaging technology is the application of materials and methods to create, preserve, or duplicate images.
...
*
Image processing
An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
*
imc FAMOS (1987), graphical data analysis
*
Land cover mapping
*
Military intelligence
*
Remote sensing
References
Further reading
* ''The Image Processing Handbook'' by John C. Russ, (2006)
* ''Image Processing and Analysis - Variational, PDE, Wavelet, and Stochastic Methods'' by
Tony F. Chan an
Jianhong (Jackie) Shen (2005)
* ''Front-End Vision and Multi-Scale Image Analysis'' by Bart M. ter Haar Romeny, Paperback, (2003)
* ''Practical Guide to Image Analysis'' by J.J. Friel, et al.,
ASM International, (2000).
* ''Fundamentals of Image Processing'' by Ian T. Young, Jan J. Gerbrands, Lucas J. Van Vliet, Paperback, (1995)
* ''Image Analysis and Metallography'' edited by P.J. Kenny, et al.,
International Metallographic Society and
ASM International (1989).
* ''Quantitative Image Analysis of Microstructures'' by H.E. Exner & H.P. Hougardy, DGM Informationsgesellschaft mbH, (1988).
* "Metallographic and Materialographic Specimen Preparation, Light Microscopy, Image Analysis and Hardness Testing", Kay Geels in collaboration with Struers A/S, ASTM International 2006.
{{Authority control
Computer vision
Formal sciences