CaltechAUTHORS
  A Caltech Library Service

Reinforcement-learning in fronto-striatal circuits

Averbeck, Bruno and O'Doherty, John P. (2021) Reinforcement-learning in fronto-striatal circuits. Neuropsychopharmacology . ISSN 0893-133X. doi:10.1038/s41386-021-01108-0. (In Press) https://resolver.caltech.edu/CaltechAUTHORS:20210809-151305575

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20210809-151305575

Abstract

We review the current state of knowledge on the computational and neural mechanisms of reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the literature in this area into five broad research themes: the target of the learning—whether it be learning about the value of stimuli or about the value of actions; the nature and complexity of the algorithm used to drive the learning and inference process; how learned values get converted into choices and associated actions; the nature of state representations, and of other cognitive machinery that support the implementation of various reinforcement-learning operations. An emerging fifth area focuses on how the brain allocates or arbitrates control over different reinforcement-learning sub-systems or “experts”. We will outline what is known about the role of the prefrontal cortex and striatum in implementing each of these functions. We then conclude by arguing that it will be necessary to build bridges from algorithmic level descriptions of computational reinforcement-learning to implementational level models to better understand how reinforcement-learning emerges from multiple distributed neural networks in the brain.


Item Type:Article
Related URLs:
URLURL TypeDescription
https://doi.org/10.1038/s41386-021-01108-0DOIArticle
https://rdcu.be/ctIykPublisherFree ReadCube access
ORCID:
AuthorORCID
Averbeck, Bruno0000-0002-3976-8565
O'Doherty, John P.0000-0003-0016-3531
Additional Information:© The Author(s), under exclusive licence to American College of Neuropsychopharmacology 2021. Received 04 March 2021; Revised 06 July 2021; Accepted 09 July 2021; Published 05 August 2021. JOD is supported by grants from the National Institutes of Mental Health (R01MH11425, R01MH121089, R21MH120805 and the NIMH Caltech Conte Center on the neurobiology of social decision-making, P50MH094258) and the National Institute on Drug Abuse (R01DA040011). This work was supported in part by the intramural research program of NIMH (BBA: ZIA MH002928). Author Contributions: BBA and JOD jointly planned the scope of the review, reviewed the literature, prepared figures, wrote the paper and revised the paper following reviewer comments. The authors declare no competing interests.
Funders:
Funding AgencyGrant Number
NIHR01MH11425
NIHR01MH121089
NIHR21MH120805
Caltech Conte Center for the Neurobiology of Social Decision MakingUNSPECIFIED
NIHP50MH094258
NIHR01DA040011
NIHZIA MH002928
Subject Keywords:Motivation; Reward
DOI:10.1038/s41386-021-01108-0
Record Number:CaltechAUTHORS:20210809-151305575
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20210809-151305575
Official Citation:Averbeck, B., O’Doherty, J.P. Reinforcement-learning in fronto-striatal circuits. Neuropsychopharmacol. (2021). https://doi.org/10.1038/s41386-021-01108-0
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:110161
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:09 Aug 2021 20:16
Last Modified:09 Aug 2021 20:16

Repository Staff Only: item control page