15 October 2012 Eurecom, Sophia-Antipolis Thrasyvoulos Spyropoulos / Discrete Time Markov Chains.
If you can't read please download the document
-
Upload
hillary-reynolds -
Category
Documents
-
view
221 -
download
0
description
Thrasyvoulos Spyropoulos / Eurecom, Sophia-Antipolis Assume state space: 0, 1, 2, … P ij : P{S(n+1) = j | S(n) = i} Stationary: P{S(n+1) = j | S(n) = i} = P{S(1) = j | S(0) = i} for any n p ij define a transition matrix P = 3
