Explore relationships

Markov decision process

A Markov decision process (MDP) is a mathematical model for sequential decision making when outcomes are uncertain. It is a type of stochastic decision process, and is often solved using the methods of stochastic dynamic programming.

Use + to expand a branch. Click a topic name to open its summary.