1 Introduction to Stochastic Models GSLM 54100. 2 Outline limiting distribution connectivity types of states and of irreducible DTMCs transient,