(a) Write down the one-step transition matrix P for the following state transition diagram. (b) Find the n-step transition matrix P(n) for n = 200 and 300. Then determine if this Markov chain has steady-state? (4)

Determine whether the statement below is true or false. Justify the answer. If (x) is a Markov chain, then X₁+1 must depend only on the transition matrix and xn- Choose the correct answer below. O A. The statement is false because x, depends on X₁+1 and the transition matrix. B. The statement is true because it is part of the definition of a Markov chain. C. The statement is false because X₁ +1 can also depend on X-1 D. The statement is false because X₁ + 1 can also depend on any previous entry in the chain.

C)

Consider a random walk on the graph with 6 vertices below. Suppose that 0 and 5 are absorbing vertices, but the random walker is more strongly attracted to 5 than to 0. So for each turn, the probability that the walker moves right is 0.7, while the probability he moves left is only 0.3. (a) Write the transition matrix P for this Markov process. (b) Find POO. (c) What is the probability that a walker starting at vertex 1 is absorbed by vertex 0? (d) What is the probability that a walker starting at vertex 1 is absorbed by vertex 5? (e) What is the probability that a walker starting at vertex 4 is absorbed by vertex 5? (f) What is the probability that a walker starting at vertex 3 is absorbed by vertex 5? What is the expected number of times that a walker starting at vertex 1 will visit vertex 2? (h) What is the expected number of times that a walker starting at vertex 1 will visit vertex 4? N;B The diagram is a horizontal line showing points 0, 1, 2, 3, 4, and 5

Linear Algebra