In
mathematics,
computer science
Computer science is the study of computation, automation, and information. Computer science spans theoretical disciplines (such as algorithms, theory of computation, information theory, and automation) to practical disciplines (includin ...
and
economics
Economics () is the social science that studies the production, distribution, and consumption of goods and services.
Economics focuses on the behaviour and interactions of economic agents and how economies work. Microeconomics analy ...
, an optimization problem is the
problem
Problem solving is the process of achieving a goal by overcoming obstacles, a frequent part of most activities. Problems in need of solutions range from simple personal tasks (e.g. how to turn on an appliance) to complex issues in business an ...
of finding the ''best'' solution from all
feasible solutions.
Optimization problems can be divided into two categories, depending on whether the
variables are
continuous or
discrete:
* An optimization problem with discrete variables is known as a ''
discrete optimization'', in which an
object such as an
integer
An integer is the number zero (), a positive natural number (, , , etc.) or a negative integer with a minus sign ( −1, −2, −3, etc.). The negative numbers are the additive inverses of the corresponding positive numbers. In the language ...
,
permutation
In mathematics, a permutation of a set is, loosely speaking, an arrangement of its members into a sequence or linear order, or if the set is already ordered, a rearrangement of its elements. The word "permutation" also refers to the act or p ...
or
graph
Graph may refer to:
Mathematics
*Graph (discrete mathematics), a structure made of vertices and edges
**Graph theory, the study of such graphs and their properties
*Graph (topology), a topological space resembling a graph in the sense of discre ...
must be found from a
countable set
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural number ...
.
* A problem with continuous variables is known as a ''
continuous optimization'', in which an optimal value from a
continuous function must be found. They can include
constrained problems and multimodal problems.
Continuous optimization problem
The ''
standard form'' of a
continuous optimization problem is
where
* is the
objective function
In mathematical optimization and decision theory, a loss function or cost function (sometimes also called an error function) is a function that maps an event or values of one or more variables onto a real number intuitively representing some "cos ...
to be minimized over the -variable vector ,
* are called inequality
constraints
* are called equality constraints, and
* and .
If , the problem is an unconstrained optimization problem. By convention, the standard form defines a minimization problem. A maximization problem can be treated by
negating the objective function.
Combinatorial optimization problem
Formally, a
combinatorial optimization problem is a quadruple , where
* is a
set of instances;
* given an instance , is the set of feasible solutions;
* given an instance and a feasible solution of , denotes the
measure of , which is usually a
positive real.
* is the goal function, and is either or .
The goal is then to find for some instance an ''optimal solution'', that is, a feasible solution with
For each combinatorial optimization problem, there is a corresponding
decision problem that asks whether there is a feasible solution for some particular measure . For example, if there is a
graph
Graph may refer to:
Mathematics
*Graph (discrete mathematics), a structure made of vertices and edges
**Graph theory, the study of such graphs and their properties
*Graph (topology), a topological space resembling a graph in the sense of discre ...
which contains vertices and , an optimization problem might be "find a path from to that uses the fewest edges". This problem might have an answer of, say, 4. A corresponding decision problem would be "is there a path from to that uses 10 or fewer edges?" This problem can be answered with a simple 'yes' or 'no'.
In the field of
approximation algorithms, algorithms are designed to find near-optimal solutions to hard problems. The usual decision version is then an inadequate definition of the problem since it only specifies acceptable solutions. Even though we could introduce suitable decision problems, the problem is more naturally characterized as an optimization problem.
See also
*
*
*
*
*
*
* − the optimum need not be found, just a "good enough" solution.
*
*
References
External links
*
{{Authority control
Computational problems