Format

Send to

Choose Destination
See comment in PubMed Commons below
Psychol Rev. 2012 Jan;119(1):120-54. doi: 10.1037/a0026435.

Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.

Author information

1
Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08540, USA.

Abstract

Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory addressing habit formation, centering on temporal-difference learning mechanisms. Less progress has been made toward formalizing the processes involved in goal-directed decision making. We draw on recent work in cognitive neuroscience, animal conditioning, cognitive and developmental psychology, and machine learning to outline a new theory of goal-directed decision making. Our basic proposal is that the brain, within an identifiable network of cortical and subcortical structures, implements a probabilistic generative model of reward, and that goal-directed decision making is effected through Bayesian inversion of this model. We present a set of simulations implementing the account, which address benchmark behavioral and neuroscientific findings, and give rise to a set of testable predictions. We also discuss the relationship between the proposed framework and other models of decision making, including recent models of perceptual choice, to which our theory bears a direct connection.

PMID:
22229491
PMCID:
PMC3767755
DOI:
10.1037/a0026435
[Indexed for MEDLINE]
Free PMC Article
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for American Psychological Association Icon for PubMed Central
    Loading ...
    Support Center