Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published August 9, 2006 | Published + Supplemental Material
Journal Article Open

Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans

Abstract

Many real-life decision-making problems incorporate higher-order structure, involving interdependencies between different stimuli, actions, and subsequent rewards. It is not known whether brain regions implicated in decision making, such as the ventromedial prefrontal cortex (vmPFC), use a stored model of the task structure to guide choice (model-based decision making) or merely learn action or state values without assuming higher-order structure as in standard reinforcement learning. To discriminate between these possibilities, we scanned human subjects with functional magnetic resonance imaging while they performed a simple decision-making task with higher-order structure, probabilistic reversal learning. We found that neural activity in a key decision-making region, the vmPFC, was more consistent with a computational model that exploits higher-order structure than with simple reinforcement learning. These results suggest that brain regions, such as the vmPFC, use an abstract model of task structure to guide behavioral choice, computations that may underlie the human capacity for complex social interactions and abstract strategizing.

Additional Information

© 2006 Society for Neuroscience. Received March 7, 2006; revised July 7, 2006; accepted July 8, 2006. This work was supported by California Institute of Technology start-up funds to J.P.O. from the Gimbel Discovery Fund in Neuroscience. A.N.H. was partly supported by the Physical Sciences Division of the National Aeronautics and Space Administration Office of Biological and Physical Research. We thank Nathaniel Daw for helpful comments on this manuscript. We also thank Steve Flaherty and Mike Tyzska for technical and MRI support.

Attached Files

Published - 8360.full.pdf

Supplemental Material - Figure-3.gif

Supplemental Material - SuppFig1.gif

Supplemental Material - SuppFig2.gif

Supplemental Material - SupplementaryData2.pdf

Files

SupplementaryData2.pdf
Files (689.7 kB)
Name Size Download all
md5:27cd7b645ff4689e7b1838f1749150eb
291.1 kB Preview Download
md5:04180d2b406b5c590c456d983c0f8ea0
270.3 kB Preview Download
md5:eb1a36ae2fee8d8c2695ba1952049878
88.3 kB Preview Download
md5:f51a39b9d6ec8a0d4d840656329044a5
16.7 kB Preview Download
md5:481eae2ba30f97987f2cd8751bff3387
23.3 kB Preview Download

Additional details

Created:
August 22, 2023
Modified:
October 18, 2023