A Caltech Library Service

Optimal rewarding harvesting in complex visual environments

Navalpakkam, Vidhya and Koch, Christof and Rangel, Antonio and Perona, Pietro (2010) Optimal rewarding harvesting in complex visual environments. Proceedings of the National Academy of Sciences of the United States of America, 107 (11). pp. 5232-5237. ISSN 0027-8424. PMCID PMC2841865.

PDF - Published Version
See Usage Policy.

PDF - Supplemental Material
See Usage Policy.


Use this Persistent URL to link to this item:


The ability to choose rapidly among multiple targets embedded in a complex perceptual environment is key to survival. Targets may differ in their reward value as well as in their low-level perceptual properties (e.g., visual saliency). Previous studies investigated separately the impact of either value or saliency on choice; thus, it is not known how the brain combines these two variables during decision making. We addressed this question with three experiments in which human subjects attempted to maximize their monetary earnings by rapidly choosing items from a brief display. Each display contained several worthless items (distractors) as well as two targets, whose value and saliency were varied systematically. We compared the behavioral data with the predictions of three computational models assuming that (i) subjects seek the most valuable item in the display, (ii) subjects seek the most easily detectable item, and (iii) subjects behave as an ideal Bayesian observer who combines both factors to maximize the expected reward within each trial. Regardless of the type of motor response used to express the choices, we find that decisions are influenced by both value and feature-contrast in a way that is consistent with the ideal Bayesian observer, even when the targets’ feature-contrast is varied unpredictably between trials. This suggests that individuals are able to harvest rewards optimally and dynamically under time pressure while seeking multiple targets embedded in perceptual clutter.

Item Type:Article
Related URLs:
URLURL TypeDescription DOIArticle material CentralPubMed article
Koch, Christof0000-0001-6482-8067
Perona, Pietro0000-0002-7583-5809
Additional Information:Approved January 22, 2010 (received for review October 16, 2009). Copyright © 2010 National Academy of Sciences. We thank Mike Landy, the two anonymous reviewers, and the editor for their valuable comments on the manuscript. This work was supported by grants from the National Geospatial-Intelligence Agency, the Office of Naval Research, the National Science Foundation, and the National Institutes of Health. The funding agencies had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Group:Koch Laboratory, KLAB
Funding AgencyGrant Number
National Geospatial-Intelligence AgencyUNSPECIFIED
Office of Naval Research (ONR)UNSPECIFIED
Subject Keywords:decision making ; reward ; visual saliency ; search ; multiple targets
PubMed Central ID:PMC2841865
Record Number:CaltechAUTHORS:20130816-103404368
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:40687
Deposited By: KLAB Import
Deposited On:10 Feb 2012 23:18
Last Modified:08 May 2017 21:54

Repository Staff Only: item control page