Quantum reinforcement learning during human decision-making

Nat Hum Behav. 2020 Mar;4(3):294-307. doi: 10.1038/s41562-019-0804-2. Epub 2020 Jan 20.

Abstract

Classical reinforcement learning (CRL) has been widely applied in neuroscience and psychology; however, quantum reinforcement learning (QRL), which shows superior performance in computer simulations, has never been empirically tested on human decision-making. Moreover, all current successful quantum models for human cognition lack connections to neuroscience. Here we studied whether QRL can properly explain value-based decision-making. We compared 2 QRL and 12 CRL models by using behavioural and functional magnetic resonance imaging data from healthy and cigarette-smoking subjects performing the Iowa Gambling Task. In all groups, the QRL models performed well when compared with the best CRL models and further revealed the representation of quantum-like internal-state-related variables in the medial frontal gyrus in both healthy subjects and smokers, suggesting that value-based decision-making can be illustrated by QRL at both the behavioural and neural levels.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Brain Mapping*
  • Cigarette Smoking / physiopathology*
  • Decision Making / physiology*
  • Executive Function / physiology*
  • Humans
  • Magnetic Resonance Imaging
  • Models, Theoretical*
  • Prefrontal Cortex / diagnostic imaging
  • Prefrontal Cortex / physiology*
  • Prefrontal Cortex / physiopathology
  • Quantum Theory
  • Reinforcement, Psychology*