Science. 2004 Dec 10;306(5703):1944-7.

Addiction as a computational process gone awry.

Source

Department of Neuroscience, 6-145 Jackson Hall, 321 Church Street SE, University of Minnesota, Minneapolis, MN 55455, USA. redish@ahc.umn.edu

Abstract

Addictive drugs have been hypothesized to access the same neurophysiological mechanisms as natural learning systems. These natural learning systems can be modeled through temporal-difference reinforcement learning (TDRL), which requires a reward-error signal that has been hypothesized to be carried by dopamine. TDRL learns to predict reward by driving that reward-error signal to zero. By adding a noncompensable drug-induced dopamine increase to a TDRL model, a computational model of addiction is constructed that over-selects actions leading to drug receipt. The model provides an explanation for important aspects of the addiction literature and provides a theoretic view-point with which to address other aspects.

Comment in

PMID:: 15591205; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms

Publication Types

Research Support, Non-U.S. Gov't

MeSH Terms

LinkOut - more resources

Full Text Sources

Other Literature Sources

Medical

Cocaine - MedlinePlus Health Information

Libraries

LinkOut Holdings

Supplemental Content

Save items

Related citations in PubMed

Neuroscience. Addiction as compulsive reward prediction. [Science. 2004]
Neuroscience. Addiction as compulsive reward prediction.
Ahmed SH. Science. 2004 Dec 10; 306(5703):1901-2.
A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. [Neuroscience. 1999]
A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task.
Suri RE, Schultz W. Neuroscience. 1999; 91(3):871-90.
A neurocomputational model for cocaine addiction. [Neural Comput. 2009]
A neurocomputational model for cocaine addiction.
Dezfouli A, Piray P, Keramati MM, Ekhtiari H, Lucas C, Mokri A. Neural Comput. 2009 Oct; 21(10):2869-93.
Review Addiction: a disease of learning and memory. [Am J Psychiatry. 2005]
Review Addiction: a disease of learning and memory.
Hyman SE. Am J Psychiatry. 2005 Aug; 162(8):1414-22.
Review TD models of reward predictive responses in dopamine neurons. [Neural Netw. 2002]
Review TD models of reward predictive responses in dopamine neurons.
Suri RE. Neural Netw. 2002 Jun-Jul; 15(4-6):523-33.

See reviews... See all...

Cited by 45 PubMed Central articles

Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement. [PLoS One. 2012]
Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement.
Kim KM, Baratta MV, Yang A, Lee D, Boyden ES, Fiorillo CD. PLoS One. 2012; 7(4):e33612. Epub 2012 Apr 10.
Dopamine, affordance and active inference. [PLoS Comput Biol. 2012]
Dopamine, affordance and active inference.
Friston KJ, Shiner T, FitzGerald T, Galea JM, Adams R, Brown H, Dolan RJ, Moran R, Stephan KE, Bestmann S. PLoS Comput Biol. 2012 Jan; 8(1):e1002327. Epub 2012 Jan 5.
Novel pharmacological approaches to treatment of drug overdose and addiction. [Expert Rev Clin Pharmacol. 2009]
Novel pharmacological approaches to treatment of drug overdose and addiction.
Zhan CG. Expert Rev Clin Pharmacol. 2009; 2(1):1-4.

See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Compound (MeSH Keyword)
PubChem chemical compound records that are classified under the same Medical Subject Headings (MeSH) controlled vocabulary as the current articles.
Substance (MeSH Keyword)
PubChem chemical substance (submitted) records that are classified under the same Medical Subject Headings (MeSH) controlled vocabulary as the current articles.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.

Recent activity

Clear Turn Off Turn On

Addiction as a computational process gone awry.
Addiction as a computational process gone awry.
Science. 2004 Dec 10 ;306(5703):1944-7.

PubMed
Sex, HIV and the injecting drug user.
Sex, HIV and the injecting drug user.
Br J Addict. 1992 Mar ;87(3):405-16.

PubMed
Using social networks to understand and prevent substance use: a transdisciplina...
Using social networks to understand and prevent substance use: a transdisciplinary perspective.
Subst Use Misuse. 2004 ;39(10-12):1685-712.

PubMed
Alcohol consumption and mortality in an American male population: recovering the...
Alcohol consumption and mortality in an American male population: recovering the U-shaped curve--findings from the normative Aging Study.
J Stud Alcohol. 1992 Jan ;53(1):25-32.

PubMed
African-American women who use crack cocaine: a comparison of mothers who live w...
African-American women who use crack cocaine: a comparison of mothers who live with and have been separated from their children.
Child Abuse Negl. 2004 Nov ;28(11):1229-47.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Result Filters

Display Settings:

Send to: