Format

Send to

Choose Destination
Neural Comput. 2008 Jul;20(7):1706-16. doi: 10.1162/neco.2008.10-06-351.

Online learning with hidden markov models.

Author information

1
Group for Neural Theory, Department d'Etudes Cognitives, Ecole Normale Supérieure, Collège de France, Paris 75006, France. Gianluigi.Mongillo@ens.fr

Abstract

We present an online version of the expectation-maximization (EM) algorithm for hidden Markov models (HMMs). The sufficient statistics required for parameters estimation is computed recursively with time, that is, in an online way instead of using the batch forward-backward procedure. This computational scheme is generalized to the case where the model parameters can change with time by introducing a discount factor into the recurrence relations. The resulting algorithm is equivalent to the batch EM algorithm, for appropriate discount factor and scheduling of parameters update. On the other hand, the online algorithm is able to deal with dynamic environments, i.e., when the statistics of the observed data is changing with time. The implications of the online algorithm for probabilistic modeling in neuroscience are briefly discussed.

PMID:
18254694
DOI:
10.1162/neco.2008.10-06-351
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Atypon
Loading ...
Support Center