Format

Send to

Choose Destination
Neural Netw. 2007 Apr;20(3):365-76. Epub 2007 May 3.

Decoupled echo state networks with lateral inhibition.

Author information

1
Electrical and Computer Engineering Department, McMaster University, Hamilton, Ontario, L8S 4K1, Canada. yxue@soma.mcmaster.ca

Abstract

Building on some prior work, in this paper we describe a novel structure termed the decoupled echo state network (DESN) involving the use of lateral inhibition. Two low-complexity implementation schemes, namely, the DESN with reservoir prediction (DESN + RP) and DESN with maximum available information (DESN + MaxInfo), are developed: (1) In the multiple superimposed oscillator (MSO) problem, DESN + MaxInfo exhibits three important attributes: lower generalization mean-square error (MSE), better robustness with respect to the random generation of reservoir weight matrix and feedback connections, and robustness to variations in the sparseness of reservoir weight matrix, compared to DESN + RP. (2) For a noiseless nonlinear prediction task, DESN + RP outperforms the DESN + MaxInfo and single reservoir-based ESN approach in terms of lower prediction MSE and better robustness to a change in the number of inputs and sparsity of the reservoir weight matrix. Finally, in a real-life prediction task using noisy sea clutter data, both schemes exhibit higher prediction accuracy and successful design ratio than a conventional ESN with a single reservoir.

PMID:
17517490
DOI:
10.1016/j.neunet.2007.04.014
[Indexed for MEDLINE]

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center