Question

If, on the first observation the system is in state 1, what is the probability that it is in state 1 on the third observation?

Answer 1

p(x=1,3) = 0.6*0.6 + 0.4*0.6 = 0.6
hope it helps