Scoring (The Forward Algorithm)

By this algorithm, we can evaluate the probability that a given HMM model produced a given observation sequence. Given an HMM model M , consisting of tex2html_wrap_inline3650 , tex2html_wrap_inline3624 , and tex2html_wrap_inline3654 , we compute the probability of the input sequence tex2html_wrap_inline3656 .

First, we define tex2html_wrap_inline3658 as the probability of generating the partial sequence tex2html_wrap_inline3660 , ending up in state j at time t . tex2html_wrap_inline3666 is initialized to 1.0 in the initial state, and 0.0 in all other states. If we have already computed tex2html_wrap_inline3668 for all i in the previous time frame t-1, then tex2html_wrap_inline3658 can be computed recursively in terms of the incremental probability of entering state j from each i while generating the output symbol tex2html_wrap_inline3680 (see Figure 2.5):

equation298

   figure301
図 2.5: Forward pass recursion in HMM

If F is the final state, then we see that tex2html_wrap_inline3700 is the probability that the HMM generated the complete output sequence tex2html_wrap_inline3702 .


next up previous contents
Next: Segmentation (The Viterbi Algorithm) Up: 2.3.2 Hidden Markov Models Previous: 2.3.2 Hidden Markov Models

Jo Chul-Ho
Wed Oct 13 17:59:27 JST 1999