A) / B) / C) Four Classes: i. Class 1:states 0 and 2 (Transient Aperiodic / Period 1) ii.

. Class 2: states 1, 3 and 4 (Recurrent Aperiodic / Period 1) iii. Class 3: state 5 (Transient No period / Aperiodic / Period 1) iv. Class 4: state 6 (Absorbing Aperiodic / Period 1) D) Mean number of times: i. Mean number of times state 2 is visited starting from state 2 = 1/(1-f2) = 4 ii. Mean number of times state 4 is visited starting from state 4 = E) Starting from state 0, probability to reach to state 1 for the first time after exactly four time periods: a. 0-2-0-2-1 : 3/64 b. 0-0-0-2-1 : 1/32 Probability: 5/64 F) First ever probability values are as follows: a. F0: 7/8 b. F3: 1 c. F5: 0 G) Starting from state 3, steady state probability of reaching to state 1 is: 0.4