Resource Bounded Measure
   HOME

TheInfoList



OR:

Lutz's resource-bounded measure is a generalisation of
Lebesgue measure In measure theory, a branch of mathematics, the Lebesgue measure, named after French mathematician Henri Lebesgue, is the standard way of assigning a measure to subsets of ''n''-dimensional Euclidean space. For ''n'' = 1, 2, or 3, it coincides wit ...
to
complexity class In computational complexity theory, a complexity class is a set of computational problems of related resource-based complexity. The two most commonly analyzed resources are time and memory. In general, a complexity class is defined in terms of ...
es. It was originally developed by
Jack Lutz Jack Lutz is a theoretical computer scientist and computational theorist best known for developing the concepts of resource bounded measure and effective dimension. He is currently a professor at Iowa State University Iowa State University ...
. Just as Lebesgue measure gives a method to quantify the size of subsets of the
Euclidean space Euclidean space is the fundamental space of geometry, intended to represent physical space. Originally, that is, in Euclid's Elements, Euclid's ''Elements'', it was the three-dimensional space of Euclidean geometry, but in modern mathematics ther ...
\R^n, resource bounded measure gives a method to classify the size of subsets of complexity classes. For instance, computer scientists generally believe that the complexity class P (the set of all
decision problem In computability theory and computational complexity theory, a decision problem is a computational problem that can be posed as a yes–no question of the input values. An example of a decision problem is deciding by means of an algorithm whethe ...
s solvable in
polynomial time In computer science, the time complexity is the computational complexity that describes the amount of computer time it takes to run an algorithm. Time complexity is commonly estimated by counting the number of elementary operations performed by ...
) is not equal to the complexity class NP (the set of all decision problems checkable, but not necessarily solvable, in polynomial time). Since P is a
subset In mathematics, Set (mathematics), set ''A'' is a subset of a set ''B'' if all Element (mathematics), elements of ''A'' are also elements of ''B''; ''B'' is then a superset of ''A''. It is possible for ''A'' and ''B'' to be equal; if they are ...
of NP, this would mean that NP contains more problems than P. A stronger hypothesis than "
P is not NP The P versus NP problem is a major unsolved problem in theoretical computer science. In informal terms, it asks whether every problem whose solution can be quickly verified can also be quickly solved. The informal term ''quickly'', used above ...
" is the statement "NP does not have p-measure 0". Here, p-measure is a generalization of Lebesgue measure to subsets of the complexity class E, in which P is contained. P is known to have p-measure 0, and so the hypothesis "NP does not have p-measure 0" would imply not only that NP and P are unequal, but that NP is, in a measure-theoretic sense, "much bigger than P".


Definition

\^\infty is the set of all
infinite Infinite may refer to: Mathematics *Infinite set, a set that is not a finite set *Infinity, an abstract concept describing something without any limit Music * Infinite (group), a South Korean boy band *''Infinite'' (EP), debut EP of American m ...
,
binary Binary may refer to: Science and technology Mathematics * Binary number, a representation of numbers using only two digits (0 and 1) * Binary function, a function that takes two arguments * Binary operation, a mathematical operation that t ...
sequences In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is called t ...
. We can view a
real number In mathematics, a real number is a number that can be used to measure a ''continuous'' one-dimensional quantity such as a distance, duration or temperature. Here, ''continuous'' means that values can have arbitrarily small variations. Every real ...
in the
unit interval In mathematics, the unit interval is the closed interval , that is, the set of all real numbers that are greater than or equal to 0 and less than or equal to 1. It is often denoted ' (capital letter ). In addition to its role in real analysis, ...
as an infinite binary sequence, by considering its
binary expansion A binary number is a number expressed in the base-2 numeral system or binary numeral system, a method of mathematical expression which uses only two symbols: typically "0" (zero) and "1" ( one). The base-2 numeral system is a positional notatio ...
. We may also view a
language Language is a structured system of communication. The structure of a language is its grammar and the free components are its vocabulary. Languages are the primary means by which humans communicate, and may be conveyed through a variety of met ...
(a set of binary
strings String or strings may refer to: *String (structure), a long flexible structure made from threads twisted together, which is used to tie, bind, or hang other objects Arts, entertainment, and media Films * ''Strings'' (1991 film), a Canadian anim ...
) as an infinite binary sequence, by setting the ''n''th
bit The bit is the most basic unit of information in computing and digital communications. The name is a portmanteau of binary digit. The bit represents a logical state with one of two possible values. These values are most commonly represente ...
of the sequence to 1 if and only if the ''n''th binary string (in
lexicographical order In mathematics, the lexicographic or lexicographical order (also known as lexical order, or dictionary order) is a generalization of the alphabetical order of the dictionaries to sequences of ordered symbols or, more generally, of elements of a ...
) is contained in the language. Thus, sets of real numbers in the unit interval and complexity classes (which are sets of languages) may both be viewed as sets of infinite binary sequences, and thus the techniques of
measure theory In mathematics, the concept of a measure is a generalization and formalization of geometrical measures ( length, area, volume) and other common notions, such as mass and probability of events. These seemingly distinct concepts have many simil ...
used to measure the size of sets of real numbers may be applied to measure complexity classes. However, since each computable complexity class contains only a
countable In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural numbers; ...
number of elements(because the number of computable languages is countable), each complexity class has
Lebesgue measure In measure theory, a branch of mathematics, the Lebesgue measure, named after French mathematician Henri Lebesgue, is the standard way of assigning a measure to subsets of ''n''-dimensional Euclidean space. For ''n'' = 1, 2, or 3, it coincides wit ...
0. Thus, to do measure theory inside of complexity classes, we must define an alternative
measure Measure may refer to: * Measurement, the assignment of a number to a characteristic of an object or event Law * Ballot measure, proposed legislation in the United States * Church of England Measure, legislation of the Church of England * Mea ...
that works meaningfully on countable sets of infinite sequences. For this measure to be meaningful, it should reflect something about the underlying definition of each complexity class; namely, that they are defined by
computational problem In theoretical computer science, a computational problem is a problem that may be solved by an algorithm. For example, the problem of factoring :"Given a positive integer ''n'', find a nontrivial prime factor of ''n''." is a computational probl ...
s that can be solved within a given resource bound. The foundation of resource-bounded measure is Ville's formulation of martingales. A martingale is a function d:\^*\to ,\infty)_such_that,_for_all_finite_strings_''w'', :d(w)_=_\frac. (This_is_Ville's_original_definition_of_a_martingale,_later_extended_by_Joseph_Leo_Doob.)_A_martingale_''d''_is_said_to_succeed_on_a_sequence_S\in\^\infty_if_\limsup__d(S_\upharpoonright_n)_=_\infty,_where_S_\upharpoonright_n_is_the_first_''n''_bits_of_''S''._A_martingale_succeeds_on_a_set_of_sequences_X\subseteq\^\infty_if_it_succeeds_on_every_sequence_in_''X''._ Intuitively,_a_martingale_is_a_gambler_that_starts_with_some_finite_amount_of_money_(say,_one_dollar)._It_reads_a_sequence_of_bits_indefinitely._After_reading_the_finite_prefix_w\in\^*,_it_bets_some_of_its_current_money_that_the_next_bit_will_be_a_0,_and_the_remainder_of_its_money_that_the_next_bit_will_be_a_1._It_doubles_whatever_money_was_placed_on_the_bit_that_appears_next,_and_it_loses_the_money_placed_on_the_bit_that_did_not_appear._It_must_bet_all_of_its_money,_but_it_may_"bet_nothing"_by_placing_half_of_its_money_on_each_bit._For_a_martingale_''d'',_''d''(''w'')_represents_the_amount_of_money_''d''_has_after_reading_the_string_''w''._Although_the_definition_of_a_martingale_has_the_martingale_calculating_how_much_money_it_will_have,_rather_than_calculating_what_bets_to_place,_because_of_the_constrained_nature_of_the_game,_knowledge_the_values_''d''(''w''),_''d''(''w''0),_and_''d''(''w''1)_suffices_to_calculate_the_bets_that_''d''_placed_on_0_and_1_after_seeing_the_string_''w''._The_fact_that_the_martingale_is_a_function_that_takes_as_input_the_string_seen_so_far_means_that_the_bets_placed_are_solely_a_function_of_the_bits_already_read;_no_other_information_may_affect_the_bets_(other_information_being_the_so-called_''filtration''_in_the_Martingale_(probability_theory).html" ;"title="Joseph_Leo_Doob.html" ;"title=",\infty) such that, for all finite strings ''w'', :d(w) = \frac. (This is Ville's original definition of a martingale, later extended by Joseph Leo Doob">,\infty) such that, for all finite strings ''w'', :d(w) = \frac. (This is Ville's original definition of a martingale, later extended by Joseph Leo Doob.) A martingale ''d'' is said to succeed on a sequence S\in\^\infty if \limsup_ d(S \upharpoonright n) = \infty, where S \upharpoonright n is the first ''n'' bits of ''S''. A martingale succeeds on a set of sequences X\subseteq\^\infty if it succeeds on every sequence in ''X''. Intuitively, a martingale is a gambler that starts with some finite amount of money (say, one dollar). It reads a sequence of bits indefinitely. After reading the finite prefix w\in\^*, it bets some of its current money that the next bit will be a 0, and the remainder of its money that the next bit will be a 1. It doubles whatever money was placed on the bit that appears next, and it loses the money placed on the bit that did not appear. It must bet all of its money, but it may "bet nothing" by placing half of its money on each bit. For a martingale ''d'', ''d''(''w'') represents the amount of money ''d'' has after reading the string ''w''. Although the definition of a martingale has the martingale calculating how much money it will have, rather than calculating what bets to place, because of the constrained nature of the game, knowledge the values ''d''(''w''), ''d''(''w''0), and ''d''(''w''1) suffices to calculate the bets that ''d'' placed on 0 and 1 after seeing the string ''w''. The fact that the martingale is a function that takes as input the string seen so far means that the bets placed are solely a function of the bits already read; no other information may affect the bets (other information being the so-called ''filtration'' in the Martingale (probability theory)">generalized theory of martingales). The key result relating measure to martingales is Ville's observation that a set X\subseteq\^\infty has Lebesgue measure 0 if and only if there is a martingale that succeeds on ''X''. Thus, we can define a measure 0 set to be one for which there exists a martingale that succeeds on all elements of the set. To extend this type of measure to complexity classes, Lutz considered restricting the computational power of the martingale. For instance, if instead of allowing any martingale, we require the martingale to be polynomial-time computable, then we obtain a definition of p-measure: a set of sequences has p-measure 0 if there is a ''polynomial-time computable'' martingale that succeeds on the set. We define a set to have p-measure 1 if its complement has p-measure 0. For example, proving the above-mentioned conjecture, that NP does not have p-measure 0, amounts to proving that no polynomial-time martingale succeeds on all of NP.


Almost complete

A problem is almost complete for a
complexity class In computational complexity theory, a complexity class is a set of computational problems of related resource-based complexity. The two most commonly analyzed resources are time and memory. In general, a complexity class is defined in terms of ...
C if it is in C and "many" other problems in C reduce to it. More specifically, the subset of problems of C which reduce to the problem is a measure one set, in terms of the resource bounded measure. This is a weaker requirement than the problem being
complete Complete may refer to: Logic * Completeness (logic) * Completeness of a theory, the property of a theory that every formula in the theory's language or its negation is provable Mathematics * The completeness of the real numbers, which implies t ...
for the class.


References

*


External links


Resource-Bounded Measure Bibliography
{{DEFAULTSORT:Resource Bounded Measure Structural complexity theory Measures (measure theory)