Format

Send to

Choose Destination
Proc Natl Acad Sci U S A. 2018 Oct 30;115(44):E10467-E10475. doi: 10.1073/pnas.1803839115. Epub 2018 Oct 12.

Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization.

Author information

1
Department of Neurobiology, The University of Chicago, Chicago, IL 60637; masse@uchicago.edu dfreedman@uchicago.edu.
2
Department of Neurobiology, The University of Chicago, Chicago, IL 60637.
3
The Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL 60637.

Abstract

Humans and most animals can learn new tasks without forgetting old ones. However, training artificial neural networks (ANNs) on new tasks typically causes them to forget previously learned tasks. This phenomenon is the result of "catastrophic forgetting," in which training an ANN disrupts connection weights that were important for solving previous tasks, degrading task performance. Several recent studies have proposed methods to stabilize connection weights of ANNs that are deemed most important for solving a task, which helps alleviate catastrophic forgetting. Here, drawing inspiration from algorithms that are believed to be implemented in vivo, we propose a complementary method: adding a context-dependent gating signal, such that only sparse, mostly nonoverlapping patterns of units are active for any one task. This method is easy to implement, requires little computational overhead, and allows ANNs to maintain high performance across large numbers of sequentially presented tasks, particularly when combined with weight stabilization. We show that this method works for both feedforward and recurrent network architectures, trained using either supervised or reinforcement-based learning. This suggests that using multiple, complementary methods, akin to what is believed to occur in the brain, can be a highly effective strategy to support continual learning.

KEYWORDS:

artificial intelligence; catastrophic forgetting; context-dependent gating; continual learning; synaptic stabilization

PMID:
30315147
PMCID:
PMC6217392
DOI:
10.1073/pnas.1803839115
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for HighWire Icon for PubMed Central Icon for ModelDB
Loading ...
Support Center