CaltechAUTHORS
  A Caltech Library Service

Do not bet on the unknown versus try to find out more: estimation uncertainty and “unexpected uncertainty” both modulate exploration

Payzan-LeNestour, Élise and Bossaerts, Peter (2012) Do not bet on the unknown versus try to find out more: estimation uncertainty and “unexpected uncertainty” both modulate exploration. Frontiers in Neuroscience, 6 . Art. No. 150. ISSN 1662-4548. https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580

[img]
Preview
PDF - Published Version
Creative Commons Attribution.

595Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580

Abstract

Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.3389/fnins.2012.00150DOIUNSPECIFIED
http://www.frontiersin.org/Decision_Neuroscience/10.3389/fnins.2012.00150/abstractPublisherUNSPECIFIED
ORCID:
AuthorORCID
Bossaerts, Peter0000-0003-2308-2603
Additional Information:© 2012 Payzan-LeNestour and Bossaerts. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc. Received: 28 June 2012; Accepted: 19 September 2012; Published online: 16 October 2012. Edited by: Ming Hsu, University of California Berkeley, USA Reviewed by: Michael J. Frank, Brown University, USA Sander Nieuwenhuis, Leiden University, Netherlands Conflict of Interest Statement: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Subject Keywords:estimation uncertainty, unexpected uncertainty, Bayesian learning, exploration bonuses, restless bandit problem
Record Number:CaltechAUTHORS:20121106-082930580
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20121106-082930580
Official Citation:Payzan-LeNestour É and Bossaerts P (2012) Do not bet on the unknown versus try to find out more: estimation uncertainty and “unexpected uncertainty” both modulate exploration. Front. Neurosci. 6:150. doi: 10.3389/fnins.2012.00150
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:35291
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:12 Nov 2012 19:38
Last Modified:03 Oct 2019 04:27

Repository Staff Only: item control page