Markov chain analysis is a mathematical method used to study the dynamics of discrete event systems. It is based on the idea that the future state of a system is only related to its current state and not its previous states.
on chain analysis tutorial