Format

Send to

Choose Destination
Neuron. 2004 Jan 22;41(2):269-80.

Dopamine neurons can represent context-dependent prediction error.

Author information

1
Lab for Mathematical Neuroscience, RIKEN Brain Science Institute, Wako, Saitama, Japan. hiro@brain.riken.go.jp

Abstract

Midbrain dopamine (DA) neurons are thought to encode reward prediction error. Reward prediction can be improved if any relevant context is taken into account. We found that monkey DA neurons can encode a context-dependent prediction error. In the first noncontextual task, a light stimulus was randomly followed by reward, with a fixed equal probability. The response of DA neurons was positively correlated with the number of preceding unrewarded trials and could be simulated by a conventional temporal difference (TD) model. In the second contextual task, a reward-indicating light stimulus was presented with the probability that, while fixed overall, was incremented as a function of the number of preceding unrewarded trials. The DA neuronal response then was negatively correlated with this number. This history effect corresponded to the prediction error based on the conditional probability of reward and could be simulated only by implementing the relevant context into the TD model.

PMID:
14741107
DOI:
10.1016/s0896-6273(03)00869-9
[Indexed for MEDLINE]
Free full text

Supplemental Content

Full text links

Icon for Elsevier Science
Loading ...
Support Center