Topic summaryMarkov process Expand Summary Related topics Extracted from the Wikipedia article Markov chain. Discrete-time Markov process with general state space Wikipedia source