Systematic study of Markov chains and some of the simpler Markov processes including renewal theory, limit theorems for Markov chains, branching processes, queuing theory, birth and death processes, ...