Logo of pnasPNASInfo for AuthorsSubscriptionsAboutThis Article
Proc Natl Acad Sci U S A. 1982 Apr; 79(8): 2554–2558.
PMCID: PMC346238

Neural networks and physical systems with emergent collective computational abilities.


Computational properties of use of biological organisms or to the construction of computers can emerge as collective properties of systems having a large number of simple equivalent components (or neurons). The physical meaning of content-addressable memory is described by an appropriate phase space flow of the state of a system. A model of such a system is given, based on aspects of neurobiology but readily adapted to integrated circuits. The collective properties of this model produce a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. The algorithm for the time evolution of the state of the system is based on asynchronous parallel processing. Additional emergent collective properties include some capacity for generalization, familiarity recognition, categorization, error correction, and time sequence retention. The collective properties are only weakly sensitive to details of the modeling or the failure of individual devices.

Full text

Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (1.1M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.

Images in this article

Click on the image to see a larger version.

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Willows AO, Dorsett DA, Hoyle G. The neuronal basis of behavior in Tritonia. 3. Neuronal mechanism of a fixed action pattern. J Neurobiol. 1973;4(3):255–285. [PubMed]
  • Amari SI. Neural theory of association and concept-formation. Biol Cybern. 1977 May 17;26(3):175–185. [PubMed]
  • Amari S, Takeuchi A. Mathematical theory on formation of category detecting nerve cells. Biol Cybern. 1978 May 31;29(3):127–136. [PubMed]
  • Marr D. A theory of cerebellar cortex. J Physiol. 1969 Jun;202(2):437–470. [PMC free article] [PubMed]
  • Palm G. On associative memory. Biol Cybern. 1980;36(1):19–31. [PubMed]
  • Cooper LN, Liberman F, Oja E. A theory for the acquisition and loss of neuron specificity in visual cortex. Biol Cybern. 1979 Jun 29;33(1):9–28. [PubMed]
  • Longuet-Higgins HC. The non-local storage of temporal information. Proc R Soc Lond B Biol Sci. 1968 Dec 31;171(1024):327–334. [PubMed]
  • Klonguet-Higgins HC. Holographic model of temporal recall. Nature. 1968 Jan 6;217(5123):104–104. [PubMed]
  • Willwacher G. Fähigkeiten eines assoziativen Speichersystems im Vergleich zu Gehirnfunktionen. Biol Cybern. 1976 Nov 30;24(4):181–188. [PubMed]
  • John ER. Switchboard versus statistical theories of learning and memory. Science. 1972 Sep 8;177(4052):850–864. [PubMed]
  • Roney KJ, Scheibel AB, Shaw GL. Dendritic bundles: survey of anatomical experiments and physiological theories. Brain Res. 1979;180(2):225–271. [PubMed]
  • Shaw S, Nelson DL, Shearer GM. Human cytotoxic response in vitro to trinitrophenyl-modified autologous cells. I. T cell recognition of TNP in association with widely shared antigens. J Immunol. 1978 Jul;121(1):281–289. [PubMed]
  • Goldman PS, Nauta WJ. Columnar distribution of cortico-cortical fibers in the frontal association, limbic, and motor cortex of the developing rhesus monkey. Brain Res. 1977 Feb 25;122(3):393–413. [PubMed]

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences


Save items

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • Cited in Books
    Cited in Books
    PubMed Central articles cited in books
  • PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...