Science. 2004 Apr 16;304(5669):452-4.

Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ.

Source

Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK. j.odoherty@fil.ion.ucl.ac.uk

Abstract

Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.

PMID:: 15087550; [PubMed - indexed for MEDLINE]

Publication Types, MeSH Terms

Publication Types

Research Support, Non-U.S. Gov't

MeSH Terms

LinkOut - more resources

Full Text Sources

Other Literature Sources

Supplemental Content

Save items

Related citations in PubMed

Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. [J Neurophysiol. 2006]
Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning.
Haruno M, Kawato M. J Neurophysiol. 2006 Feb; 95(2):948-59. Epub 2005 Sep 28.
Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain. [J Neurophysiol. 2009]
Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain.
Valentin VV, O'Doherty JP. J Neurophysiol. 2009 Dec; 102(6):3384-91. Epub 2009 Sep 30.
Effects of dorsal and ventral striatal lesions on delayed matching trained with retractable levers. [Behav Brain Res. 2001]
Effects of dorsal and ventral striatal lesions on delayed matching trained with retractable levers.
Burk JA, Mair RG. Behav Brain Res. 2001 Jul; 122(1):67-78.
Review Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. [Neurosci Biobehav Rev. 2004]
Review Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning.
Kelley AE. Neurosci Biobehav Rev. 2004 Jan; 27(8):765-76.
Review Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix. [Ann N Y Acad Sci. 2007]
Review Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix.
Wickens JR, Budd CS, Hyland BI, Arbuthnott GW. Ann N Y Acad Sci. 2007 May; 1104:192-212. Epub 2007 Apr 7.

See reviews... See all...

Cited by over 100 PubMed Central articles

Functional MRI in awake unrestrained dogs. [PLoS One. 2012]
Functional MRI in awake unrestrained dogs.
Berns GS, Brooks AM, Spivak M. PLoS One. 2012; 7(5):e38027. Epub 2012 May 11.
Pavlovian reward prediction and receipt in schizophrenia: relationship to anhedonia. [PLoS One. 2012]
Pavlovian reward prediction and receipt in schizophrenia: relationship to anhedonia.
Dowd EC, Barch DM. PLoS One. 2012; 7(5):e35622. Epub 2012 May 4.
Surprised at all the entropy: hippocampal, caudate and midbrain contributions to learning from prediction errors. [PLoS One. 2012]
Surprised at all the entropy: hippocampal, caudate and midbrain contributions to learning from prediction errors.
Schiffer AM, Ahlheim C, Wurm MF, Schubotz RI. PLoS One. 2012; 7(5):e36445. Epub 2012 May 3.

See all...

Related information

Related Citations
Calculated set of PubMed citations closely related to the selected article(s) retrieved using a word weight algorithm. Related articles are displayed in ranked order from most to least relevant, with the “linked from” citation displayed first.
Cited in PMC
Full-text articles in the PubMed Central Database that cite the current articles.
Cited in Books
NCBI Bookshelf books that cite the current articles.

Recent activity

Clear Turn Off Turn On

Dissociable roles of ventral and dorsal striatum in instrumental conditioning.
Dissociable roles of ventral and dorsal striatum in instrumental conditioning.
Science. 2004 Apr 16 ;304(5669):452-4.

PubMed
Integrative and organ systems pharmacology: a new initiative from the National I...
Integrative and organ systems pharmacology: a new initiative from the National Institute of General Medical Sciences.
Mol Interv. 2004 Apr ;4(2):72-3.

PubMed
TC-1 is a novel tumorigenic and natively disordered protein associated with thyr...
TC-1 is a novel tumorigenic and natively disordered protein associated with thyroid cancer.
Cancer Res. 2004 Apr 15 ;64(8):2766-73.

PubMed
NIN, a gene encoding a CEP110-like centrosomal protein, is fused to PDGFRB in a ...
NIN, a gene encoding a CEP110-like centrosomal protein, is fused to PDGFRB in a patient with a t(5;14)(q33;q24) and an imatinib-responsive myeloproliferative disorder.
Cancer Res. 2004 Apr 15 ;64(8):2673-6.

PubMed
Treatment of anxiety and depressive disorders in patients with cardiovascular di...
Treatment of anxiety and depressive disorders in patients with cardiovascular disease.
BMJ. 2004 Apr 17 ;328(7445):939-43.

PubMed

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

PubMed

Result Filters

Display Settings:

Send to: