Consider a system that can be in one of two possible states, S = {0, 1}, and suppose that the state 1/5) (3/5 2/5) (4/5 transition matrix is given by P = Suppose that the system is in state 0 at time n= 0, i.e., Xo = 0. a) Draw the state transition diagram. b) Find the probability that the system is in state 1 at time n = 2. c) Find the stationary distribution of the Markov process.

Consider the migration (Markov) matrix A = 0.7 0 0.2 0.1 0.4 0.2 0.2 0.6 0.6 Suppose that, initially, there are 96 residents in location 1, 82 residents in location 2, and 151 residents in location 3. Assume time is measured in years. Find the population in each location after 1 year. Find the population in each location after 2 years.

5. consider the example below, where the states are Condition State and the transition matrix is 0 1 23 2 Πο Good as new Operable-minimum deterioration Operable-major deterioration Inoperable and replaced by a good-as-new machine we found that the steady-state probabilities are 2 13' T1= = P = 78314 00 1 0 7 13' HARTNO LELBLINO 1 16 1 1 1 1 16 8 8 0 2 2 = π2 2 13' I3 = 2 13 (a) Find the expected recurrence time for state 0 (i.e., the expected length of time a machine can be used before it must be replaced) by solving a linear system for Moo, M10, 20, and μ30. (b) Find the expected recurrence time for state O directly by the formula Moo 1 πο =

Please help me answer this question attached below.  Thank you.

3. suppose that the manufacturer keeps a spare machine that only is used when the primary machine is being repaired. During a repair day, the spare machine has a probability of 0.1 of breaking down, in which case it is repaired the next day. Denote the state of the system by (x, y), where x and y, respectively, take on the values 1 or 0 depending upon whether the primary machine (x) and the spare machine (y) are operational (value of 1) or not operational (value of 0) at the end of the day. [Hint: Note that (0, 0) is not a possible state.] (a) Construct the (one-step) transition matrix for this Markov chain. (b) Find the expected recurrence time for the state (1, 0).

Approximate the stationary matrix S for the transition matrix P by computing powers of the transition matrix P. -[: P= 0.33 0.67 0.17 0.83 S= 0 (Type an integer or decimal for each matrix element. Round to four decimal places as needed.)

Milan.stt

Please solve and show soution for question 2