Format

Send to

Choose Destination
Neurobiol Learn Mem. 2015 Sep;123:84-91. doi: 10.1016/j.nlm.2015.05.004. Epub 2015 May 22.

A frontal dopamine system for reflective exploratory behavior.

Author information

1
Department of Psychology, University of Texas at Austin, 78712, United States. Electronic address: nathanblanco@gmail.com.
2
Experimental Psychology, University College London, WC1H OAP, UK.
3
Department of Psychology, University of Texas at Austin, 78712, United States.
4
Department of Psychiatry & Human Behavior, Warren Alpert Medical School, Brown University, 02903, United States; Division of Behavioral Genetics, Rhode Island Hospital, 02903, United States.

Abstract

The COMT gene modulates dopamine levels in prefrontal cortex with Met allele carriers having lower COMT enzyme activity and, therefore, higher dopamine levels compared to Val/Val homozygotes. Concordantly, Val/Val homozygotes tend to perform worse and display increased (interpreted as inefficient) frontal activation in certain cognitive tasks. In a sample of 209 participants, we test the hypothesis that Met carriers will be advantaged in a decision-making task that demands sequencing exploratory and exploitive choices to minimize uncertainty about the reward structure in the environment. Previous work suggests that optimal performance depends on limited cognitive resources supported by prefrontal systems. If so, Met carriers should outperform Val/Val homozygotes, particularly under dual-task conditions that tax limited cognitive resources. In accord with these a priori predictions, Met carriers were more resilient in the face of cognitive load, continuing to explore in a sophisticated manner. We fit computational models that embody sophisticated reflective and simple reflexive strategies to further evaluate participants' exploration behavior. The Ideal Actor model reflectively updates beliefs and plans ahead, taking into account the information gained by each choice and making choices that maximize long-term payoffs. In contrast, the Naïve Reinforcement Learning (RL) model instantiates the reflexive account of choice, in which the values of actions are based only on the rewards experienced so far. Its beliefs are updated reflexively in response to observed changes in rewards. Converging with standard analyses, Met carriers were best characterized by the Ideal Actor model, whereas Val/Val homozygotes were best characterized by the Naive RL model, particularly under dual-task conditions.

KEYWORDS:

COMT; Computational modeling; Decision-making; Dopamine; Exploratory behavior; Genetics

PMID:
26004676
PMCID:
PMC4530051
DOI:
10.1016/j.nlm.2015.05.004
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Elsevier Science Icon for PubMed Central
Loading ...
Support Center