A Caltech Library Service

Determining the Neural Substrates of Goal-Directed Learning in the Human Brain

Valentin, Vivian V. and Dickinson, Anthony and O'Doherty, John P. (2007) Determining the Neural Substrates of Goal-Directed Learning in the Human Brain. Journal of Neuroscience, 27 (15). pp. 4019-4026. ISSN 0270-6474. PMCID PMC6672546. doi:10.1523/jneurosci.0564-07.2007.

[img] PDF - Published Version
Creative Commons Attribution.


Use this Persistent URL to link to this item:


Instrumental conditioning is considered to involve at least two distinct learning systems: a goal-directed system that learns associations between responses and the incentive value of outcomes, and a habit system that learns associations between stimuli and responses without any link to the outcome that that response engendered. Lesion studies in rodents suggest that these two distinct components of instrumental conditioning may be mediated by anatomically distinct neural systems. The aim of the present study was to determine the neural substrates of the goal-directed component of instrumental learning in humans. Nineteen human subjects were scanned with functional magnetic resonance imaging while they learned to choose instrumental actions that were associated with the subsequent delivery of different food rewards (tomato juice, chocolate milk, and orange juice). After training, one of these foods was devalued by feeding the subject to satiety on that food. The subjects were then scanned again, while being re-exposed to the instrumental choice procedure (in extinction). We hypothesized that regions of the brain involved in goal-directed learning would show changes in their activity as a function of outcome devaluation. Our results indicate that neural activity in one brain region in particular, the orbitofrontal cortex, showed a strong modulation in its activity during selection of a devalued compared with a nondevalued action. These results suggest an important contribution of orbitofrontal cortex in guiding goal-directed instrumental choices in humans.

Item Type:Article
Related URLs:
URLURL TypeDescription CentralArticle
O'Doherty, John P.0000-0003-0016-3531
Additional Information:© 2007 Society for Neuroscience. Received Nov. 21, 2006; revised March 5, 2007; accepted March 6, 2007. This work was supported by grants from the Gimbel Discovery fund for Neuroscience and National Institute of Mental Health Grant R03MH075763 to J.O.D. We thank Steve Flaherty and Mike Tyszka for technical assistance and advice.
Funding AgencyGrant Number
Gimbel Discovery FundUNSPECIFIED
Subject Keywords:decision making; habit learning; instrumental conditioning; orbitofrontal cortex; outcome devaluation; reinforcement learning; fMRI; reward
Issue or Number:15
PubMed Central ID:PMC6672546
Record Number:CaltechAUTHORS:20191025-133026682
Persistent URL:
Official Citation:Determining the Neural Substrates of Goal-Directed Learning in the Human Brain Vivian V. Valentin, Anthony Dickinson, John P. O'Doherty Journal of Neuroscience 11 April 2007, 27 (15) 4019-4026; DOI: 10.1523/JNEUROSCI.0564-07.2007
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:99463
Deposited By: George Porter
Deposited On:25 Oct 2019 23:11
Last Modified:04 Mar 2022 16:43

Repository Staff Only: item control page