Markov chains are mathematical models describing sequences of events in which the probability of each future state depends solely on the present state. Random walks constitute a prominent subclass in ...