Forward Algorithm
Section 1 - Page 2
1
2
3
4
5
6
7
8
9
10
11
12
Each column in the trellis shows the possible state of the
weather and each state in one column is connected to each state
in the adjacent columns. Each of these state transitions has a
probability provided by the state transition matrix. Under each
column is the observation at that time; the probability of this
observation given any one of the above states is provided by the
confusion matrix.
It can be seen that one method of calculating the probability of
the observed sequence would be to find each possible sequence of
the hidden states, and sum these probabilities. For the above
example, there would be 3^3=27 possible different weather
sequences, and so the probability is
Pr(dry,damp,soggy | HMM) = Pr(dry,damp,soggy | sunny,sunny,sunny)
+ Pr(dry,damp,soggy | sunny,sunny ,cloudy) + Pr(dry,damp,soggy |
sunny,sunny ,rainy) + . . . . Pr(dry,damp,soggy | rainy,rainy
,rainy)
Calculating the probability in this manner is computationally
expensive, particularly with large models or long sequences, and
we find that we can use the time invariance of the probabilities
to reduce the complexity of the problem.
|