Skip to content

IAI Actuarial Core Principles · Risk Modelling and Survival Analysis · Stochastic processes

A time-homogeneous Markov chain on states {A, B} has one-step transition matrix with P(A→A)=0.7, P(A→B)=0.3, P(B→A)=0.4, P(B→B)=0.6. The chain starts in state A. What is the probability it is in state A after two steps?

The probability is 0.61. Sum over the intermediate state at step one: staying in A twice gives 0.49, and moving to B then back to A gives 0.12. Adding both paths gives 0.61, so omitting the path through B understates it.

  1. A0.49
  2. B0.52
  3. C0.55
  4. D0.58Correct
  5. 0.61

Explanation

Two-step probability P(A→A) = 0.7×0.7 + 0.3×0.4 = 0.49 + 0.12 = 0.61. Wait: check the sum over intermediate states A and B: via A 0.49, via B 0.12, total 0.61. Option 0.49 counts only the path through A.

Did you get it right without looking?

One question tells you little. A timed set on Stochastic processes shows your real accuracy, how long you take and where you lose marks.

More Stochastic processes questions