Sheldon M Ross Stochastic Process 2nd Edition Solution Access

P X0 = 0 = P^2 (0,2) = 0.5(0.2) + 0.3(0.2) + 0.2(0.5) = 0.1 + 0.06 + 0.1 = 0.26

4.3. Consider a Markov chain with states 0, 1, and 2, and transition probability matrix: Sheldon M Ross Stochastic Process 2nd Edition Solution

Autocov(t, s) = E[(X(t) - E[X(t)]) (X(s) - E[X(s)])] = E[X(t)X(s)] = E[(A cos(t) + B sin(t))(A cos(s) + B sin(s))] = E[A^2] cos(t) cos(s) + E[B^2] sin(t) sin(s) = cos(t) cos(s) + sin(t) sin(s) = cos(t-s) P X0 = 0 = P^2 (0,2) = 0