Display Settings:

Format

Send to:

Choose Destination
See comment in PubMed Commons below
IEEE Trans Neural Netw. 2011 Jan;22(1):131-44. doi: 10.1109/TNN.2010.2089641. Epub 2010 Nov 11.

Minimum complexity echo state network.

Author information

  • 1School of Computer Science, University of Birmingham, Birmingham B15 2TT, UK. a.a.rodan@cs.bham.ac.uk

Abstract

Reservoir computing (RC) refers to a new class of state-space models with a fixed state transition structure (the reservoir) and an adaptable readout form the state space. The reservoir is supposed to be sufficiently complex so as to capture a large number of features of the input stream that can be exploited by the reservoir-to-output readout mapping. The field of RC has been growing rapidly with many successful applications. However, RC has been criticized for not being principled enough. Reservoir construction is largely driven by a series of randomized model-building stages, with both researchers and practitioners having to rely on a series of trials and errors. To initialize a systematic study of the field, we concentrate on one of the most popular classes of RC methods, namely echo state network, and ask: What is the minimal complexity of reservoir construction for obtaining competitive models and what is the memory capacity (MC) of such simplified reservoirs? On a number of widely used time series benchmarks of different origin and characteristics, as well as by conducting a theoretical analysis we show that a simple deterministically constructed cycle reservoir is comparable to the standard echo state network methodology. The (short-term) MC of linear cyclic reservoirs can be made arbitrarily close to the proved optimal value.

PMID:
21075721
[PubMed - indexed for MEDLINE]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Icon for IEEE Engineering in Medicine and Biology Society
    Loading ...
    Write to the Help Desk