Markov Chains

Stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event