Quantifier elimination is a concept of
simplification used in
mathematical logic
Mathematical logic is the study of formal logic within mathematics. Major subareas include model theory, proof theory, set theory, and recursion theory. Research in mathematical logic commonly addresses the mathematical properties of formal ...
,
model theory
In mathematical logic, model theory is the study of the relationship between formal theories (a collection of sentences in a formal language expressing statements about a mathematical structure), and their models (those structures in which the ...
, and
theoretical computer science
Theoretical computer science (TCS) is a subset of general computer science and mathematics that focuses on mathematical aspects of computer science such as the theory of computation, lambda calculus, and type theory.
It is difficult to circumsc ...
. Informally, a quantified statement "
such that
" can be viewed as a question "When is there an
such that
?", and the statement without quantifiers can be viewed as the answer to that question.
One way of classifying
formulas
In science, a formula is a concise way of expressing information symbolically, as in a mathematical formula or a ''chemical formula''. The informal use of the term ''formula'' in science refers to the general construct of a relationship betwe ...
is by the amount of
quantification. Formulas with less
depth of quantifier alternation are thought of as being simpler, with the quantifier-free formulas as the simplest.
A
theory
A theory is a rational type of abstract thinking about a phenomenon, or the results of such thinking. The process of contemplative and rational thinking is often associated with such processes as observational study or research. Theories may ...
has quantifier elimination if for every formula
, there exists another formula
without quantifiers that is
equivalent to it (
modulo
In computing, the modulo operation returns the remainder or signed remainder of a division, after one number is divided by another (called the '' modulus'' of the operation).
Given two positive numbers and , modulo (often abbreviated as ) is t ...
this theory).
Examples
An example from high school mathematics says that a single-variable
quadratic polynomial
In mathematics, a quadratic polynomial is a polynomial of degree two in one or more variables. A quadratic function is the polynomial function defined by a quadratic polynomial. Before 20th century, the distinction was unclear between a polynomia ...
has a real root if and only if its
discriminant
In mathematics, the discriminant of a polynomial is a quantity that depends on the coefficients and allows deducing some properties of the roots without computing them. More precisely, it is a polynomial function of the coefficients of the ori ...
is non-negative:
::
Here the sentence on the left-hand side involves a quantifier
, while the equivalent sentence on the right does not.
Examples of theories that have been shown decidable using quantifier elimination are
Presburger arithmetic
Presburger arithmetic is the first-order theory of the natural numbers with addition, named in honor of Mojżesz Presburger, who introduced it in 1929. The signature of Presburger arithmetic contains only the addition operation and equality, omit ...
,
algebraically closed fields,
real closed field
In mathematics, a real closed field is a field ''F'' that has the same first-order properties as the field of real numbers. Some examples are the field of real numbers, the field of real algebraic numbers, and the field of hyperreal numbers. ...
s,
atomless Boolean algebras,
term algebras,
dense linear orders,
abelian group
In mathematics, an abelian group, also called a commutative group, is a group in which the result of applying the group operation to two group elements does not depend on the order in which they are written. That is, the group operation is com ...
s,
random graph
In mathematics, random graph is the general term to refer to probability distributions over graphs. Random graphs may be described simply by a probability distribution, or by a random process which generates them. The theory of random graphs ...
s, as well as many of their combinations such as Boolean algebra with Presburger arithmetic, and term algebras with
queues.
Quantifier eliminator for the theory of the real numbers as an
ordered additive group is ''
Fourier–Motzkin elimination
Fourier–Motzkin elimination, also known as the FME method, is a mathematical algorithm for eliminating variables from a system of linear inequalities. It can output real solutions.
The algorithm is named after Joseph Fourier who proposed the ...
''; for the theory of the field of real numbers it is the ''
Tarski–Seidenberg theorem''.
Quantifier elimination can also be used to show that "combining"
decidable theories leads to new decidable theories (see
Feferman-Vaught theorem).
Algorithms and decidability
If a theory has quantifier elimination, then a specific question can be addressed: Is there a method of determining
for each
? If there is such a method we call it a quantifier elimination
algorithm
In mathematics and computer science, an algorithm () is a finite sequence of rigorous instructions, typically used to solve a class of specific problems or to perform a computation. Algorithms are used as specifications for performing ...
. If there is such an algorithm, then
decidability for the theory reduces to deciding the truth of the quantifier-free
sentences
''The Four Books of Sentences'' (''Libri Quattuor Sententiarum'') is a book of theology written by Peter Lombard in the 12th century. It is a systematic compilation of theology, written around 1150; it derives its name from the '' sententiae'' ...
. Quantifier-free sentences have no variables, so their validity in a given theory can often be computed, which enables the use of quantifier elimination algorithms to decide validity of sentences.
Related concepts
Various model-theoretic ideas are related to quantifier elimination, and there are various equivalent conditions.
Every first-order theory with quantifier elimination is
model complete. Conversely, a model-complete theory, whose theory of universal consequences has the
amalgamation property, has quantifier elimination.
The models of the theory of the universal consequences of a theory
are precisely the
substructures of the models of
. The theory of linear orders does not have quantifier elimination. However the theory of its universal consequences has the amalgamation property.
Basic ideas
To show constructively that a theory has quantifier elimination, it suffices to show that we can eliminate an existential quantifier applied to a conjunction of
literals, that is, show that each formula of the form:
:
where each
is a literal, is equivalent to a quantifier-free formula. Indeed, suppose we know how to eliminate quantifiers from conjunctions of literals, then if
is a quantifier-free formula, we can write it in
disjunctive normal form
In boolean logic, a disjunctive normal form (DNF) is a canonical normal form of a logical formula consisting of a disjunction of conjunctions; it can also be described as an OR of ANDs, a sum of products, or (in philosophical logic) a ''cluster co ...
:
and use the fact that
:
is equivalent to
:
Finally, to eliminate a universal quantifier
:
where
is quantifier-free, we transform
into disjunctive normal form, and use the fact that
is equivalent to
Relationship with decidability
In early model theory, quantifier elimination was used to demonstrate that various theories possess properties like
decidability and
completeness. A common technique was to show first that a theory admits elimination of quantifiers and thereafter prove decidability or completeness by considering only the quantifier-free formulas. This technique can be used to show that
Presburger arithmetic
Presburger arithmetic is the first-order theory of the natural numbers with addition, named in honor of Mojżesz Presburger, who introduced it in 1929. The signature of Presburger arithmetic contains only the addition operation and equality, omit ...
is decidable.
Theories could be decidable yet not admit quantifier elimination. Strictly speaking, the theory of the additive natural numbers did not admit quantifier elimination, but it was an expansion of the additive natural numbers that was shown to be decidable. Whenever a theory is decidable, and the
language
Language is a structured system of communication. The structure of a language is its grammar and the free components are its vocabulary. Languages are the primary means by which humans communicate, and may be conveyed through a variety of ...
of its valid formulas is
countable
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural number ...
, it is possible to extend the theory with countably many
relations
Relation or relations may refer to:
General uses
*International relations, the study of interconnection of politics, economics, and law on a global level
*Interpersonal relationship, association or acquaintance between two or more people
*Public ...
to have quantifier elimination (for example, one can introduce, for each formula of the theory, a relation symbol that relates the
free variable
In mathematics, and in other disciplines involving formal languages, including mathematical logic and computer science, a free variable is a notation (symbol) that specifies places in an expression where substitution may take place and is n ...
s of the formula).
Example:
Nullstellensatz for
algebraically closed fields and for
differentially closed fields.
See also
*
Cylindrical algebraic decomposition
*
Elimination theory
*
Conjunction elimination
Notes
References
*
*
*
*
*
*
*
*
*, see for an English translation
*
*
*
{{Refend
Model theory