Format

Send to

Choose Destination
See comment in PubMed Commons below
Trends Cogn Sci. 2007 Oct;11(10):428-34.

Learning multiple layers of representation.

Author information

1
Department of Computer Science, University of Toronto, 10 King's College Road, Toronto, M5S 3G4, Canada. hinton@cs.toronto.edu

Abstract

To achieve its impressive performance in tasks such as speech perception or object recognition, the brain extracts multiple levels of representation from the sensory input. Backpropagation was the first computationally efficient model of how neural networks could learn multiple layers of representation, but it required labeled training data and it did not work well in deep networks. The limitations of backpropagation learning can now be overcome by using multilayer neural networks that contain top-down connections and training them to generate sensory data rather than to classify it. Learning multilayer generative models might seem difficult, but a recent discovery makes it easy to learn nonlinear distributed representations one layer at a time.

PMID:
17921042
DOI:
10.1016/j.tics.2007.09.004
[Indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Elsevier Science
    Loading ...
    Support Center