Payzan-LeNestour, Élise and Bossaerts, Peter (2012) Do not bet on the unknown versus try to find out more: estimation uncertainty and “unexpected uncertainty” both modulate exploration. Frontiers in Neuroscience, 6 . Art. No. 150. ISSN 1662-4548. doi:10.3389/fnins.2012.00150. https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580
![]()
|
PDF
- Published Version
Creative Commons Attribution. 609kB |
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580
Abstract
Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
Item Type: | Article | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Related URLs: |
| |||||||||
ORCID: |
| |||||||||
Additional Information: | © 2012 Payzan-LeNestour and Bossaerts. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc. Received: 28 June 2012; Accepted: 19 September 2012; Published online: 16 October 2012. Edited by: Ming Hsu, University of California Berkeley, USA Reviewed by: Michael J. Frank, Brown University, USA Sander Nieuwenhuis, Leiden University, Netherlands Conflict of Interest Statement: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. | |||||||||
Subject Keywords: | estimation uncertainty, unexpected uncertainty, Bayesian learning, exploration bonuses, restless bandit problem | |||||||||
DOI: | 10.3389/fnins.2012.00150 | |||||||||
Record Number: | CaltechAUTHORS:20121106-082930580 | |||||||||
Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580 | |||||||||
Official Citation: | Payzan-LeNestour É and Bossaerts P (2012) Do not bet on the unknown versus try to find out more: estimation uncertainty and “unexpected uncertainty” both modulate exploration. Front. Neurosci. 6:150. doi: 10.3389/fnins.2012.00150 | |||||||||
Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | |||||||||
ID Code: | 35291 | |||||||||
Collection: | CaltechAUTHORS | |||||||||
Deposited By: | Tony Diaz | |||||||||
Deposited On: | 12 Nov 2012 19:38 | |||||||||
Last Modified: | 09 Nov 2021 23:14 |
Repository Staff Only: item control page