In
computer graphics
Computer graphics deals with generating images with the aid of computers. Today, computer graphics is a core technology in digital photography, film, video games, cell phone and computer displays, and many specialized applications. A great de ...
, the rendering equation is an
integral equation
In mathematics, integral equations are equations in which an unknown Function (mathematics), function appears under an integral sign. In mathematical notation, integral equations may thus be expressed as being of the form: f(x_1,x_2,x_3,...,x_n ; ...
in which the equilibrium
radiance
In radiometry, radiance is the radiant flux emitted, reflected, transmitted or received by a given surface, per unit solid angle per unit projected area. Radiance is used to characterize diffuse emission and reflection of electromagnetic radiati ...
leaving a point is given as the sum of emitted plus reflected radiance under a geometric
optics
Optics is the branch of physics that studies the behaviour and properties of light, including its interactions with matter and the construction of instruments that use or detect it. Optics usually describes the behaviour of visible, ultraviole ...
approximation. It was simultaneously introduced into computer graphics by David Immel et al. and
James Kajiya
James Kajiya is a pioneer in the field of computer graphics. He is perhaps best known for the development of the rendering equation.
Kajiya received his PhD from the University of Utah in 1979, was a professor at Caltech from 1979 through 199 ...
in 1986. The various realistic
rendering techniques in computer graphics attempt to solve this equation.
The physical basis for the rendering equation is the law of
conservation of energy
In physics and chemistry, the law of conservation of energy states that the total energy of an isolated system remains constant; it is said to be ''conserved'' over time. This law, first proposed and tested by Émilie du Châtelet, means th ...
. Assuming that ''L'' denotes
radiance
In radiometry, radiance is the radiant flux emitted, reflected, transmitted or received by a given surface, per unit solid angle per unit projected area. Radiance is used to characterize diffuse emission and reflection of electromagnetic radiati ...
, we have that at each particular position and direction, the outgoing light (L
o) is the sum of the emitted light (L
e) and the reflected light. The reflected light itself is the sum from all directions of the incoming light (L
i) multiplied by the surface reflection and cosine of the incident angle.
Equation form
The rendering equation may be written in the form
:
where
*
is the total
spectral radiance In radiometry, spectral radiance or specific intensity is the radiance of a surface per unit frequency or wavelength, depending on whether the Spectral radiometric quantity, spectrum is taken as a function of frequency or of wavelength. The Internat ...
of wavelength
directed outward along direction
at time
, from a particular position
*
is the location in space
*
is the direction of the outgoing light
*
is a particular wavelength of light
*
is time
*
is
emitted spectral radiance
*
is an
integral
In mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented i ...
over
*
is the unit
hemisphere
Hemisphere refers to:
* A half of a sphere
As half of the Earth
* A hemisphere of Earth
** Northern Hemisphere
** Southern Hemisphere
** Eastern Hemisphere
** Western Hemisphere
** Land and water hemispheres
* A half of the (geocentric) celes ...
centered around
containing all possible values for
where
*
is the
bidirectional reflectance distribution function
The bidirectional reflectance distribution function (BRDF; f_(\omega_,\, \omega_) ) is a function of four real variables that defines how light is reflected at an opaque surface. It is employed in the optics of real-world light, in compute ...
, the proportion of light reflected from
to
at position
, time
, and at wavelength
*
is the negative direction of the incoming light
*
is spectral radiance of wavelength
coming inward toward
from direction
at time
*
is the
surface normal
In geometry, a normal is an object such as a line, ray, or vector that is perpendicular to a given object. For example, the normal line to a plane curve at a given point is the (infinite) line perpendicular to the tangent line to the curve at ...
at
*
is the weakening factor of outward
irradiance In radiometry, irradiance is the radiant flux ''received'' by a ''surface'' per unit area. The SI unit of irradiance is the watt per square metre (W⋅m−2). The CGS unit erg per square centimetre per second (erg⋅cm−2⋅s−1) is often used ...
due to
incident angle, as the light flux is smeared across a surface whose area is larger than the projected area perpendicular to the ray. This is often written as
.
Two noteworthy features are: its linearity—it is composed only of multiplications and additions, and its spatial homogeneity—it is the same in all positions and orientations. These mean a wide range of factorings and rearrangements of the equation are possible. It is a
Fredholm integral equation In mathematics, the Fredholm integral equation is an integral equation whose solution gives rise to Fredholm theory, the study of Fredholm kernels and Fredholm operators. The integral equation was studied by Ivar Fredholm. A useful method to so ...
of the second kind, similar to those that arise in
quantum field theory
In theoretical physics, quantum field theory (QFT) is a theoretical framework that combines classical field theory, special relativity, and quantum mechanics. QFT is used in particle physics to construct physical models of subatomic particles and ...
.
Note this equation's
spectral
''Spectral'' is a 2016 3D military science fiction, supernatural horror fantasy and action-adventure thriller war film directed by Nic Mathieu. Written by himself, Ian Fried, and George Nolfi from a story by Fried and Mathieu. The film stars ...
and
time
Time is the continued sequence of existence and events that occurs in an apparently irreversible succession from the past, through the present, into the future. It is a component quantity of various measurements used to sequence events, to ...
dependence —
may be sampled at or integrated over sections of the
visible spectrum
The visible spectrum is the portion of the electromagnetic spectrum that is visual perception, visible to the human eye. Electromagnetic radiation in this range of wavelengths is called ''visible light'' or simply light. A typical human eye wil ...
to obtain, for example, a
trichromatic
Trichromacy or trichromatism is the possessing of three independent channels for conveying color information, derived from the three different types of cone cells in the eye. Organisms with trichromacy are called trichromats.
The normal expl ...
color sample. A pixel value for a single frame in an animation may be obtained by fixing
motion blur
Motion blur is the apparent streaking of moving objects in a photograph or a sequence of frames, such as a film or animation. It results when the image being recorded changes during the recording of a single exposure, due to rapid movement or lo ...
can be produced by
averaging
In ordinary language, an average is a single number taken as representative of a list of numbers, usually the sum of the numbers divided by how many numbers are in the list (the arithmetic mean). For example, the average of the numbers 2, 3, 4, 7, ...
over some given time interval (by integrating over the time interval and dividing by the length of the interval).
Note that a solution to the rendering equation is the function
. The function
is related to
via a ray-tracing operation: The incoming radiance from some direction at one point is the outgoing radiance at some other point in the opposite direction.
Applications
Solving the rendering equation for any given scene is the primary challenge in
realistic rendering
Global illumination (GI), or indirect illumination, is a group of algorithms used in 3D computer graphics that are meant to add more realistic lighting to 3D scenes. Such algorithms take into account not only the light that comes directly from ...
. One approach to solving the equation is based on
finite element
The finite element method (FEM) is a popular method for numerically solving differential equations arising in engineering and mathematical modeling. Typical problem areas of interest include the traditional fields of structural analysis, heat t ...
methods, leading to the
radiosity algorithm. Another approach using
Monte Carlo method
Monte Carlo methods, or Monte Carlo experiments, are a broad class of computational algorithms that rely on repeated random sampling to obtain numerical results. The underlying concept is to use randomness to solve problems that might be determi ...
s has led to many different algorithms including
path tracing
Path tracing is a computer graphics Monte Carlo method of rendering images of three-dimensional scenes such that the global illumination is faithful to reality. Fundamentally, the algorithm is integrating over all the illuminance arriving to ...
,
photon mapping
In computer graphics, photon mapping is a two-pass global illumination rendering algorithm developed by Henrik Wann Jensen between 1995 and 2001Jensen, H. (1996). ''Global Illumination using Photon Maps''. nlineAvailable at: http://graphics.stanf ...
, and
Metropolis light transport
Metropolis light transport (MLT) is a global illumination application of a variant of the Monte Carlo method called the Metropolis–Hastings algorithm to the rendering equation for generating images from detailed physical descriptions of three- ...
, among others.
Limitations
Although the equation is very general, it does not capture every aspect of light reflection. Some missing aspects include the following:
*
Transmission, which occurs when light is transmitted through the surface, such as when it hits a
glass
Glass is a non-crystalline, often transparent, amorphous solid that has widespread practical, technological, and decorative use in, for example, window panes, tableware, and optics. Glass is most often formed by rapid cooling (quenching) of ...
object or a
water
Water (chemical formula ) is an inorganic, transparent, tasteless, odorless, and nearly colorless chemical substance, which is the main constituent of Earth's hydrosphere and the fluids of all known living organisms (in which it acts as a ...
surface,
*
Subsurface scattering
Subsurface scattering (SSS), also known as subsurface light transport (SSLT), is a mechanism of light transport in which light that penetrates the surface of a translucent object is scattered by interacting with the material and exits the surfa ...
, where the spatial locations for incoming and departing light are different. Surfaces rendered without accounting for subsurface scattering may appear unnaturally opaque — however, it is not necessary to account for this if transmission is included in the equation, since that will effectively include also light scattered under the surface,
*
Polarization, where different light polarizations will sometimes have different reflection distributions, for example when light bounces at a water surface,
*
Phosphorescence
Phosphorescence is a type of photoluminescence related to fluorescence. When exposed to light (radiation) of a shorter wavelength, a phosphorescent substance will glow, absorbing the light and reemitting it at a longer wavelength. Unlike fluo ...
, which occurs when light or other
electromagnetic radiation
In physics, electromagnetic radiation (EMR) consists of waves of the electromagnetic field, electromagnetic (EM) field, which propagate through space and carry momentum and electromagnetic radiant energy. It includes radio waves, microwaves, inf ...
is
absorbed at one moment and emitted at a later moment, usually with a longer
wavelength
In physics, the wavelength is the spatial period of a periodic wave—the distance over which the wave's shape repeats.
It is the distance between consecutive corresponding points of the same phase on the wave, such as two adjacent crests, tro ...
(unless the absorbed electromagnetic radiation is very intense),
*
Interference
Interference is the act of interfering, invading, or poaching. Interference may also refer to:
Communications
* Interference (communication), anything which alters, modifies, or disrupts a message
* Adjacent-channel interference, caused by extr ...
, where the wave properties of light are exhibited,
*
Fluorescence
Fluorescence is the emission of light by a substance that has absorbed light or other electromagnetic radiation. It is a form of luminescence. In most cases, the emitted light has a longer wavelength, and therefore a lower photon energy, tha ...
, where the absorbed and emitted light have different
wavelength
In physics, the wavelength is the spatial period of a periodic wave—the distance over which the wave's shape repeats.
It is the distance between consecutive corresponding points of the same phase on the wave, such as two adjacent crests, tro ...
s,
*
Non-linear
In mathematics and science, a nonlinear system is a system in which the change of the output is not proportional to the change of the input. Nonlinear problems are of interest to engineers, biologists, physicists, mathematicians, and many other ...
effects, where very intense light can increase the
energy level
A quantum mechanical system or particle that is bound—that is, confined spatially—can only take on certain discrete values of energy, called energy levels. This contrasts with classical particles, which can have any amount of energy. The te ...
of an
electron
The electron ( or ) is a subatomic particle with a negative one elementary electric charge. Electrons belong to the first generation of the lepton particle family,
and are generally thought to be elementary particles because they have no kn ...
with more energy than that of a single
photon
A photon () is an elementary particle that is a quantum of the electromagnetic field, including electromagnetic radiation such as light and radio waves, and the force carrier for the electromagnetic force. Photons are massless, so they always ...
(this can occur if the electron is hit by two photons at the same time), and
emission of light with higher frequency than the frequency of the light that hit the surface suddenly becomes possible, and
*
Doppler effect, where light that bounces off an object moving at a very high speed will get its wavelength changed: if the light bounces off an object that is moving towards it, the light will be
blueshift
In physics, a redshift is an increase in the wavelength, and corresponding decrease in the frequency and photon energy, of electromagnetic radiation (such as light). The opposite change, a decrease in wavelength and simultaneous increase in f ...
ed and the
photon
A photon () is an elementary particle that is a quantum of the electromagnetic field, including electromagnetic radiation such as light and radio waves, and the force carrier for the electromagnetic force. Photons are massless, so they always ...
s will be packed more closely so the photon flux will be increased; if it bounces off an object moving away from it, it will be
redshift
In physics, a redshift is an increase in the wavelength, and corresponding decrease in the frequency and photon energy, of electromagnetic radiation (such as light). The opposite change, a decrease in wavelength and simultaneous increase in f ...
ed and the photon flux will be decreased. This effect becomes apparent only at speeds comparable to the
speed of light
The speed of light in vacuum, commonly denoted , is a universal physical constant that is important in many areas of physics. The speed of light is exactly equal to ). According to the special theory of relativity, is the upper limit ...
, which is not the case for most rendering applications.
For scenes that are either not composed of simple surfaces in a vacuum or for which the travel time for light is an important factor, researchers have generalized the rendering equation to produce a ''volume rendering equation'' suitable for
volume rendering
In scientific visualization and computer graphics, volume rendering is a set of techniques used to display a 2D projection of a 3D discretely sampled data set, typically a 3D scalar field.
A typical 3D data set is a group of 2D slice imag ...
and a ''transient rendering equation''
[{{Cite techreport, first=Adam M., last=Smith , author2=Skorupski, James , author3=Davis, James, title=Transient Rendering, number=UCSC-SOE-08-26, institution=UC Santa Cruz, year=2008 , url=http://classes.soe.ucsc.edu/cmps290b/Fall07/TransientRendering/ucsc-soe-08-26.pdf] for use with data from a
time-of-flight camera
A time-of-flight camera (ToF camera), also known as time-of-flight sensor (ToF sensor), is a range imaging camera system for measuring distances between the camera and the subject for each point of the image based on time-of-flight, the round ...
.
References
External links
Lecture notesfrom Stanford University course CS 348B, ''Computer Graphics: Image Synthesis Techniques''
Computer graphics