Format

Send to:

Choose Destination

Similar articles for PubMed (Select 23109525)

  • PMID: 23109525 was deleted because it is a duplicate of PMID: 23681989
See comment in PubMed Commons below
IEEE Trans Pattern Anal Mach Intell. 2013 Jul;35(7):1592-605. doi: 10.1109/TPAMI.2012.240.

Automatic relevance determination in nonnegative matrix factorization with the β-divergence.

Author information

  • 1Institute for Infocomm Research, A*STAR, Singapore and National Universityof Singapore, Singapore. vtan@nus.edu.sg

Abstract

This paper addresses the estimation of the latent dimensionality in nonnegative matrix factorization (NMF) with the β-divergence. The β-divergence is a family of cost functions that includes the squared euclidean distance, Kullback-Leibler (KL) and Itakura-Saito (IS) divergences as special cases. Learning the model order is important as it is necessary to strike the right balance between data fidelity and overfitting. We propose a Bayesian model based on automatic relevance determination (ARD) in which the columns of the dictionary matrix and the rows of the activation matrix are tied together through a common scale parameter in their prior. A family of majorization-minimization (MM) algorithms is proposed for maximum a posteriori (MAP) estimation. A subset of scale parameters is driven to a small lower bound in the course of inference, with the effect of pruning the corresponding spurious components. We demonstrate the efficacy and robustness of our algorithms by performing extensive experiments on synthetic data, the swimmer dataset, a music decomposition example, and a stock price prediction task.

PMID:
23681989
[PubMed - indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Loading ...
    Write to the Help Desk