10.5 Model Solution Three steps to create a Markov model: 1) Construct the state diagram by identifying all possible states that the modeled system may.