Reinforcement learning can account for associative and perceptual learning on a visual-decision task

Nat Neurosci. 2009 May;12(5):655-63. doi: 10.1038/nn.2304. Epub 2009 Apr 19.

Abstract

We recently showed that improved perceptual performance on a visual motion direction-discrimination task corresponds to changes in how an unmodified sensory representation in the brain is interpreted to form a decision that guides behavior. Here we found that these changes can be accounted for using a reinforcement-learning rule to shape functional connectivity between the sensory and decision neurons. We modeled performance on the basis of the readout of simulated responses of direction-selective sensory neurons in the middle temporal area (MT) of monkey cortex. A reward prediction error guided changes in connections between these sensory neurons and the decision process, first establishing the association between motion direction and response direction, and then gradually improving perceptual sensitivity by selectively strengthening the connections from the most sensitive neurons in the sensory population. The results suggest a common, feedback-driven mechanism for some forms of associative and perceptual learning.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Association Learning / physiology*
  • Computer Simulation
  • Decision Making / physiology*
  • Feedback / physiology
  • Haplorhini
  • Models, Neurological
  • Motion Perception / physiology
  • Neural Networks, Computer
  • Neural Pathways / physiology
  • Neuropsychological Tests
  • Photic Stimulation
  • Psychomotor Performance / physiology*
  • Reinforcement, Psychology*
  • Reward
  • Visual Perception / physiology*