Continuous Stochastic Process

In probability theory, a continuous stochastic process is a type of stochastic process that may be said to be "continuous" as a function of its "time" or index parameter. Continuity is a nice property for (the sample paths of) a process to have, since it implies that they are well-behaved in some sense, and, therefore, much easier to analyze. It is implicit here that the index of the stochastic process is a continuous variable. Some authorsDodge, Y. (2006) ''The Oxford Dictionary of Statistical Terms'', OUP. (Entry for "continuous process") define a "continuous (stochastic) process" as only requiring that the index variable be continuous, without continuity of sample paths: in some terminology, this would be a continuous-time stochastic process, in parallel to a "discrete-time process". Given the possible confusion, caution is needed.

Definitions

Let (Ω, Σ, P) be a probability space, let ''T'' be some interval of time, and let ''X'' : ''T'' × Ω → ''S'' be a stochastic process. For simplicity, the rest of this article will take the state space ''S'' to be the real line R, but the definitions go through ''mutatis mutandis'' if ''S'' is R^''n'', a normed vector space, or even a general metric space.

Continuity with probability one

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous with probability one at ''t'' if

:$\mathbf \left( \left\ \right) = 1.$

Mean-square continuity

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous in mean-square at ''t'' if E \big, _X__-_X__\big, ^_\right=_0.

_Continuity_in_probability

Given_a_time_''t'' ∈ ''T'',_''X''_is_said_to_be_continuous_in_probability_at_''t''_if,_for_all_''ε'' > 0,

:$\lim__\mathbf_\left(_\left\_\right)_=_0.$

Equivalently,_''X''_is_continuous_in_probability_at_time_''t''_if

:\lim__\mathbf_\left \frac_\right=_0.

_Continuity_in_distribution

Given_a_time_''t'' ∈ ''T'',_''X''_is_said_to_be_continuous_in_distribution_at_''t''_if

:$\lim__F__(x)_=_F__(x)$

for_all_points_''x''_at_which_''F''_''t''_is_continuous,_where_''F''_''t''_denotes_the_cumulative_distribution_function_of_the_random_variable_''X''_''t''.

_Sample_continuity

''X''_is_said_to_be_sample_continuous_if_''X''_''t''(''ω'')_is_continuous_in_''t''_for_P-almost_all_''ω'' ∈ Ω._Sample_continuity_is_the_appropriate_notion_of_continuity_for_processes_such_as_Itō_diffusions.

_Feller_continuity

''X''_is_said_to_be_a_Feller-continuous_process_if,_for_any_fixed_''t'' ∈ ''T''_and_any_bounded,_continuous_and_Σ-measurable_function_''g'' : ''S'' → R,_E^''x'' 'g''(''X''_''t'')depends_continuously_upon_''x''._Here_''x''_denotes_the_initial_state_of_the_process_''X'',_and_E^''x''_denotes_expectation_conditional_upon_the_event_that_''X''_starts_at_''x''.

_Relationships

The_relationships_between_the_various_types_of_continuity_of_stochastic_processes_are_akin_to_the_relationships_between_the_various_types_of_convergence_of_random_variables._In_particular:
*_continuity_with_probability_one_implies_continuity_in_probability;
*_continuity_in_mean-square_implies_continuity_in_probability;
*_continuity_with_probability_one_neither_implies,_nor_is_implied_by,_continuity_in_mean-square;
*_continuity_in_probability_implies,_but_is_not_implied_by,_continuity_in_distribution.

It_is_tempting_to_confuse_continuity_with_probability_one_with_sample_continuity._Continuity_with_probability_one_at_time_''t''_means_that_P(''A''_''t'') = 0,_where_the_event_''A''_''t''_is_given_by

:$A__=_\left\,$

and_it_is_perfectly_feasible_to_check_whether_or_not_this_holds_for_each_''t'' ∈ ''T''._Sample_continuity,_on_the_other_hand,_requires_that_P(''A'') = 0,_where

:$A_=_\bigcup__A_.$

''A''_is_an_uncountable_union_of_events,_so_it_may_not_actually_be_an_event_itself,_so_P(''A'')_may_be_undefined!_Even_worse,_even_if_''A''_is_an_event,_P(''A'')_can_be_strictly_positive_even_if_P(''A''_''t'') = 0_for_every_''t'' ∈ ''T''._This_is_the_case,_for_example,_with_the_telegraph_process.

_Notes

_References

*_
*_{{cite_book_
, _last_=_Øksendal
, _first_=_Bernt_K.
, _author-link_=_Bernt_Øksendal
, _title_=_Stochastic_Differential_Equations:_An_Introduction_with_Applications_
, _edition_=_Sixth
, _publisher=Springer
, _location_=_Berlin_
, _year_=_2003_
, _isbn_=_3-540-04758-1
_(See_Lemma_8.1.4)

Stochastic_processeshtml" ;"title="''X''_''t'', ²] < +∞ and

:\lim_ \mathbf \left \big, X_ - X_ \big, ^ \right= 0.

Continuity in probability

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous in probability at ''t'' if, for all ''ε'' > 0,

:$\lim_ \mathbf \left( \left\ \right) = 0.$

Equivalently, ''X'' is continuous in probability at time ''t'' if

:\lim_ \mathbf \left \frac \right= 0.

Continuity in distribution

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous in distribution at ''t'' if

:$\lim_ F_ (x) = F_ (x)$

for all points ''x'' at which ''F''_''t'' is continuous, where ''F''_''t'' denotes the cumulative distribution function of the random variable ''X''_''t''.

Sample continuity

''X'' is said to be sample continuous if ''X''_''t''(''ω'') is continuous in ''t'' for P-almost all ''ω'' ∈ Ω. Sample continuity is the appropriate notion of continuity for processes such as Itō diffusions.

Feller continuity

''X'' is said to be a Feller-continuous process if, for any fixed ''t'' ∈ ''T'' and any bounded, continuous and Σ-measurable function ''g'' : ''S'' → R, E^''x'' 'g''(''X''_''t'')depends continuously upon ''x''. Here ''x'' denotes the initial state of the process ''X'', and E^''x'' denotes expectation conditional upon the event that ''X'' starts at ''x''.

Relationships

The relationships between the various types of continuity of stochastic processes are akin to the relationships between the various types of convergence of random variables. In particular:
* continuity with probability one implies continuity in probability;
* continuity in mean-square implies continuity in probability;
* continuity with probability one neither implies, nor is implied by, continuity in mean-square;
* continuity in probability implies, but is not implied by, continuity in distribution.

It is tempting to confuse continuity with probability one with sample continuity. Continuity with probability one at time ''t'' means that P(''A''_''t'') = 0, where the event ''A''_''t'' is given by

:$A_ = \left\,$

and it is perfectly feasible to check whether or not this holds for each ''t'' ∈ ''T''. Sample continuity, on the other hand, requires that P(''A'') = 0, where

:$A = \bigcup_ A_.$

''A'' is an uncountable union of events, so it may not actually be an event itself, so P(''A'') may be undefined! Even worse, even if ''A'' is an event, P(''A'') can be strictly positive even if P(''A''_''t'') = 0 for every ''t'' ∈ ''T''. This is the case, for example, with the telegraph process.

Notes

References

*
* {{cite book
, last = Øksendal
, first = Bernt K.
, author-link = Bernt Øksendal
, title = Stochastic Differential Equations: An Introduction with Applications
, edition = Sixth
, publisher=Springer
, location = Berlin
, year = 2003
, isbn = 3-540-04758-1
(See Lemma 8.1.4)

Stochastic processes>''X''_''t'', ²nbsp;< +∞ and

:\lim_ \mathbf \left \big, X_ - X_ \big, ^ \right= 0.

Continuity in probability

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous in probability at ''t'' if, for all ''ε'' > 0,

:$\lim_ \mathbf \left( \left\ \right) = 0.$

Equivalently, ''X'' is continuous in probability at time ''t'' if

:\lim_ \mathbf \left \frac \right= 0.

Continuity in distribution

Given a time ''t'' ∈ ''T'', ''X'' is said to be continuous in distribution at ''t'' if

:$\lim_ F_ (x) = F_ (x)$

for all points ''x'' at which ''F''_''t'' is continuous, where ''F''_''t'' denotes the cumulative distribution function of the random variable ''X''_''t''.

Sample continuity

''X'' is said to be sample continuous if ''X''_''t''(''ω'') is continuous in ''t'' for P-almost all ''ω'' ∈ Ω. Sample continuity is the appropriate notion of continuity for processes such as Itō diffusions.

Feller continuity

''X'' is said to be a Feller-continuous process if, for any fixed ''t'' ∈ ''T'' and any bounded, continuous and Σ-measurable function ''g'' : ''S'' → R, E^''x'' 'g''(''X''_''t'')depends continuously upon ''x''. Here ''x'' denotes the initial state of the process ''X'', and E^''x'' denotes expectation conditional upon the event that ''X'' starts at ''x''.

Relationships

The relationships between the various types of continuity of stochastic processes are akin to the relationships between the various types of convergence of random variables. In particular:
* continuity with probability one implies continuity in probability;
* continuity in mean-square implies continuity in probability;
* continuity with probability one neither implies, nor is implied by, continuity in mean-square;
* continuity in probability implies, but is not implied by, continuity in distribution.

It is tempting to confuse continuity with probability one with sample continuity. Continuity with probability one at time ''t'' means that P(''A''_''t'') = 0, where the event ''A''_''t'' is given by

:$A_ = \left\,$

and it is perfectly feasible to check whether or not this holds for each ''t'' ∈ ''T''. Sample continuity, on the other hand, requires that P(''A'') = 0, where

:$A = \bigcup_ A_.$

''A'' is an uncountable union of events, so it may not actually be an event itself, so P(''A'') may be undefined! Even worse, even if ''A'' is an event, P(''A'') can be strictly positive even if P(''A''_''t'') = 0 for every ''t'' ∈ ''T''. This is the case, for example, with the telegraph process.

Notes

References

*
* {{cite book
, last = Øksendal
, first = Bernt K.
, author-link = Bernt Øksendal
, title = Stochastic Differential Equations: An Introduction with Applications
, edition = Sixth
, publisher=Springer
, location = Berlin
, year = 2003
, isbn = 3-540-04758-1
(See Lemma 8.1.4)

Stochastic processes