Markov Chain -- from Wolfram MathWorld
https://mathworld.wolfram.com/MarkovChain.html17.12.2021 · Markov Chain. A Markov chain is collection of random variables (where the index runs through 0, 1, ...) having the property that, given the present, the future is conditionally independent of the past. In other words, If a Markov sequence of random variates take the discrete values , ..., , then. and the sequence is called a Markov chain ...