Bray, Signe and Shimojo, Shinsuke and O'Doherty, John P. (2007) Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback. Journal of Neuroscience, 27 (28). pp. 7498-7507. ISSN 0270-6474. PMCID PMC6672599. doi:10.1523/jneurosci.2118-07.2007. https://resolver.caltech.edu/CaltechAUTHORS:20191025-133026602
![]() |
PDF
- Published Version
Creative Commons Attribution. 472kB |
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20191025-133026602
Abstract
Successful learning is often contingent on feedback. In instrumental conditioning, an animal or human learns to perform specific responses to obtain reward. Instrumental conditioning is often used by behavioral psychologists to train an animal (or human) to produce a desired behavior. Shaping involves reinforcing those behaviors, which in a stepwise manner are successively closer to the desired behavior until the desired behavior is reached. Here, we aimed to extend this traditional approach to directly shape neural activity instead of overt behavior. To achieve this, we scanned 22 human subjects with functional magnetic resonance imaging and performed image processing in parallel with acquisition. We delineated regions of interest (ROIs) in finger and toe motor/somatosensory regions and used an instrumental shaping procedure to induce a regionally specific increase in activity by providing an explicit monetary reward to reinforce neural activity in the target areas. After training, we found a significant and regionally specific increase in activity in the ROI being rewarded (finger or toe) and a decrease in activity in the nonrewarded region. This demonstrates that instrumental conditioning procedures can be used to directly shape neural activity, even without the production of an overt behavioral response. This procedure offers an important alternative to traditional biofeedback-based approaches and may be useful in the development of future therapies for stroke and other brain disorders.
Item Type: | Article | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Related URLs: |
| |||||||||
ORCID: |
| |||||||||
Additional Information: | © 2007 Society for Neuroscience. Received Jan. 15, 2007; revised June 4, 2007; accepted June 4, 2007. This work was supported by a Dana Foundation grant to J.P.O., by the Japan Science and Technology Agency ERATO (Exploratory Research for Advanced Technology) Shimojo Implicit brain function project, and by a Gordon and Betty Moore grant to the Caltech Brain Imaging Center. We thank Mike Tzyska for invaluable assistance with technical setup as well as Steven Flaherty and Ralph Lee. We also thank Masamichi Sakagami and Shinsuke Kobayashi for their input. | |||||||||
Funders: |
| |||||||||
Subject Keywords: | conditioned; conditioning; feedback; fMRI; motor cortex; operant; reward | |||||||||
Issue or Number: | 28 | |||||||||
PubMed Central ID: | PMC6672599 | |||||||||
DOI: | 10.1523/jneurosci.2118-07.2007 | |||||||||
Record Number: | CaltechAUTHORS:20191025-133026602 | |||||||||
Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20191025-133026602 | |||||||||
Official Citation: | Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback Signe Bray, Shinsuke Shimojo, John P. O'Doherty Journal of Neuroscience 11 July 2007, 27 (28) 7498-7507; DOI: 10.1523/JNEUROSCI.2118-07.2007 | |||||||||
Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | |||||||||
ID Code: | 99462 | |||||||||
Collection: | CaltechAUTHORS | |||||||||
Deposited By: | George Porter | |||||||||
Deposited On: | 25 Oct 2019 22:22 | |||||||||
Last Modified: | 04 Mar 2022 16:41 |
Repository Staff Only: item control page