Chapter 8.7, Problem 21E

(a)

To determine

To calculate: The two-step transition matrix for $P=\left[\begin{array}{ccc}0& 1& 0\\ \frac{1}{3}& \frac{1}{3}& \frac{1}{3}\\ 1& 0& 0\end{array}\right]$.

(b)

To determine

To calculate: The distribution vectors after one, two and three steps for $P=\left[\begin{array}{ccc}0& 1& 0\\ \frac{1}{3}& \frac{1}{3}& \frac{1}{3}\\ 1& 0& 0\end{array}\right]$.