Tags Markov chains Code 96-S3-Q12 Year 1996 Step 3 Question number 12 Professor Ecks, proving theorem, matrices. [STEP III 1996 Question 12 (Probability and Statistics)]