Format

Send to

Choose Destination
Hum Brain Mapp. 2018 Jul;39(7):2887-2906. doi: 10.1002/hbm.24047. Epub 2018 Mar 25.

Separate neural representations of prediction error valence and surprise: Evidence from an fMRI meta-analysis.

Author information

1
Institute of Neuroscience & Psychology, University of Glasgow, Glasgow, United Kingdom.
2
Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom.
3
Department of Behavioural & Social Sciences, University of Huddersfield, Huddersfield, United Kingdom.

Abstract

Learning occurs when an outcome differs from expectations, generating a reward prediction error signal (RPE). The RPE signal has been hypothesized to simultaneously embody the valence of an outcome (better or worse than expected) and its surprise (how far from expectations). Nonetheless, growing evidence suggests that separate representations of the two RPE components exist in the human brain. Meta-analyses provide an opportunity to test this hypothesis and directly probe the extent to which the valence and surprise of the error signal are encoded in separate or overlapping networks. We carried out several meta-analyses on a large set of fMRI studies investigating the neural basis of RPE, locked at decision outcome. We identified two valence learning systems by pooling studies searching for differential neural activity in response to categorical positive-versus-negative outcomes. The first valence network (negative > positive) involved areas regulating alertness and switching behaviours such as the midcingulate cortex, the thalamus and the dorsolateral prefrontal cortex whereas the second valence network (positive > negative) encompassed regions of the human reward circuitry such as the ventral striatum and the ventromedial prefrontal cortex. We also found evidence of a largely distinct surprise-encoding network including the anterior cingulate cortex, anterior insula and dorsal striatum. Together with recent animal and electrophysiological evidence this meta-analysis points to a sequential and distributed encoding of different components of the RPE signal, with potentially distinct functional roles.

KEYWORDS:

decision making; learning; meta-analysis; prediction error; reward

PMID:
29575249
DOI:
10.1002/hbm.24047

Supplemental Content

Full text links

Icon for Wiley
Loading ...
Support Center