Construct a transition probability matrix of a Markov chain with state space {1,2,…,7,8} in which {1,2,3} is recurrent having period 2, {4,5,6,7} is recurrent having period 3, and {8} is aperiodic transient.

Name: Construct a transition probability matrix of a Markov chain with state space {1,2,…,7,8} in which {1,2,3} is recurrent having period 2, {4,5,6,7} is recurrent having period 3, and {8} is aperiodic transient.
Brand: Quizplus
Rating: 4.7 (41 reviews)

Question

Quizplus · Accepted Answer

The Answer is

\left( \begin{array} { l l l l l l l l } 0 & 1 & 0 & 0 & 0 & 0 & 0 & 0 \0 & 0 & 1 & 0 & 0 & 0 & 0 & 0 \0 & 1 & 0 & 0 & 0 & 0 & 0 & 0 \1 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \0 & 0 & 0 & 0 & 1 & 0 & 0 & 0 \0 & 0 & 0 & 0 & 0 & 1 & 0 & 0 \0 & 0 & 0 & .5 & 0 & 0 & .5 & 0 \0 & 0 & 0 & 0 & 1 & 0 & 0 & 0 \0 & 0 & 0 & 1 & 0 & 0 & 0 & 0\end{array} ight)

Construct a Transition Probability Matrix of a Markov Chain with State