Academic
Publications
The Hierarchical Hidden Markov Model: Analysis and Applications

The Hierarchical Hidden Markov Model: Analysis and Applications,Machine Learning,Shai Fine,Yoram Singer,Naftali Tishby

The Hierarchical Hidden Markov Model: Analysis and Applications   (Citations: 330)
BibTex | RIS | RefWorks Download
We introduce, analyze and demonstrate a recursive hierarchical generalization of the widely used hidden Markov models, which we name Hierarchical Hidden Markov Models (HHMM). Our model is motivated by the complex multi-scale structure which appears in many natural sequences, particularly in language, handwriting and speech. We seek a systematic unsupervised approach to the modeling of such structures. By extending the standard Baum-Welch (forward-backward) algorithm, we derive an efficient procedure for estimating the model parameters from unlabeled data. We then use the trained model for automatic hierarchical parsing of observation sequences. We describe two applications of our model and its parameter estimation procedure. In the first application we show how to construct hierarchical models of natural English text. In these models different levels of the hierarchy correspond to structures on different length scales in the text. In the second application we demonstrate how HHMMs can be used to automatically identify repeated strokes that represent combination of letters in cursive handwriting.
Journal: Machine Learning - ML , vol. 32, no. 1, pp. 41-62, 1998
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
Sort by: