We are given an MDP with 3 states: Red, Green, Blue (RGB).
Emission probabilities: R --> 1 (probably 0.5), 2, (p=0.5) G --> 1 (p=0.5), 3 (p=0.5) B --> 2 (p=0.5), 4 (p=0.5).
Transition Matrix: R -> G (p = 1.0), G -> B (p = 1.0), B -> R (p = 1.0).
These are the observations: 1, 2, 3, 4, 1, 2, 3, 2, 1, 3
What is the most likely explanation for this observation sequence?
Initial state is not known and is equally likely from all states.