CaltechAUTHORS
  A Caltech Library Service

Why and how the brain weights contributions from a mixture of experts

O'Doherty, John P. and Lee, Sangwan and Tadayonnejad, Reza and Cockburn, Jeff and Iigaya, Kyo and Charpentier, Caroline J. (2021) Why and how the brain weights contributions from a mixture of experts. Neuroscience and Biobehavioral Reviews, 123 . pp. 14-23. ISSN 0149-7634. https://resolver.caltech.edu/CaltechAUTHORS:20210114-164620311

[img] PDF - Accepted Version
See Usage Policy.

1MB

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20210114-164620311

Abstract

It has long been suggested that human behavior reflects the contributions of multiple systems that cooperate or compete for behavioral control. Here we propose that the brain acts as a “Mixture of Experts” in which different expert systems propose strategies for action. It will be argued that the brain determines which experts should control behavior at any one moment in time by keeping track of the reliability of the predictions within each system, and by allocating control over behavior in a manner that depends on the relative reliabilities across experts. fMRI and neurostimulation studies suggest a specific contribution of the anterior prefrontal cortex in this process. Further, such a mechanism also takes into consideration the complexity of the expert, favoring simpler over more cognitively complex experts. Results from the study of different expert systems in both experiential and social learning domains hint at the possibility that this reliability-based control mechanism is domain general, exerting control over many different expert systems simultaneously in order to produce sophisticated behavior.


Item Type:Article
Related URLs:
URLURL TypeDescription
https://doi.org/10.1016/j.neubiorev.2020.10.022DOIArticle
ORCID:
AuthorORCID
O'Doherty, John P.0000-0003-0016-3531
Lee, Sangwan0000-0001-6266-9613
Tadayonnejad, Reza0000-0002-4665-6721
Charpentier, Caroline J.0000-0002-7283-0738
Additional Information:© 2021 Elsevier. Received 9 June 2020, Revised 14 September 2020, Accepted 26 October 2020, Available online 11 January 2021. This work is supported by grants from the National Institutes of Mental Health (R01MH11425, R01MH121089, R21MH120805 and the NIMH Caltech Conte Center on the neurobiology of social decision-making, P50MH094258) and the National Institute on Drug Abuse (R01DA040011) to JOD. Author contributions: JOD, SL, RTN, JC, KI, CC discussed the concepts and the ideas in this manuscript. JOD wrote the manuscript. JOD, SL, RTN, JC, KI, CC edited and revised the manuscript. The authors report no declarations of interest.
Funders:
Funding AgencyGrant Number
NIHR01MH11425
NIHR01MH121089
NIHR21MH120805
NIHP50MH094258
NIHR01DA040011
Subject Keywords:cognitive control; Prefrontal cortex; basal ganglia; Theoretical neuroscience; Decision-making
Record Number:CaltechAUTHORS:20210114-164620311
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20210114-164620311
Official Citation:John P. O’Doherty, Sangwan Lee, Reza Tadayonnejad, Jeff Cockburn, Kyo Iigaya, Caroline J. Charpentier, Why and how the brain weights contributions from a mixture of experts, Neuroscience & Biobehavioral Reviews, Volume 123, 2021, Pages 14-23, ISSN 0149-7634, https://doi.org/10.1016/j.neubiorev.2020.10.022. (http://www.sciencedirect.com/science/article/pii/S0149763420306266)
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:107499
Collection:CaltechAUTHORS
Deposited By: George Porter
Deposited On:15 Jan 2021 17:11
Last Modified:26 Jan 2021 18:06

Repository Staff Only: item control page