Baldi, Pierre and Chauvin, Yves (1996) Hybrid modeling, HMM/NN architectures, and protein applications. Neural Computation, 8 (7). pp. 1541-1565. ISSN 0899-7667 http://resolver.caltech.edu/CaltechAUTHORS:BALnc96
- Published Version
See Usage Policy.
Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:BALnc96
We describe a hybrid modeling approach where the parameters of a model are calculated and modulated by another model, typically a neural network (NN), to avoid both overfitting and underfitting. We develop the approach for the case of Hidden Markov Models (HMMs), by deriving a class of hybrid HMM/NN architectures. These architectures can be trained with unified algorithms that blend HMM dynamic programming with NN backpropagation. In the case of complex data, mixtures of HMMs or modulated HMMs must be used. NNs can then be applied both to the parameters of each single HMM, and to the switching or modulation of the models, as a function of input or context. Hybrid HMM/NN architectures provide a flexible NN parameterization for the control of model structure and complexity. At the same time, they can capture distributions that, in practice, are inaccessible to single HMMs. The HMM/NN hybrid approach is tested, in its simplest form, by constructing a model of the immunoglobulin protein family. A hybrid model is trained, and a multiple alignment derived, with less than a fourth of the number of parameters used with previous single HMMs.
|Additional Information:||© 1996 The MIT Press. Received February 2, 1995, accepted February 8, 1996. Posted Online April 4, 2008. The work of P.B. is supported by a grant from the ONR. The work of Y.C. is supported in part by Grant R43 LM05780 from the National Library of Medicine. The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of the National Library of Medicine.|
|Subject Keywords:||HIDDEN MARKOV-MODELS; RECOGNITION; DNA|
|Usage Policy:||No commercial reproduction, distribution, display or performance rights in this work are provided.|
|Deposited By:||Marie Noren|
|Deposited On:||11 Feb 2009 04:49|
|Last Modified:||26 Dec 2012 10:47|
Repository Staff Only: item control page