CaltechAUTHORS
  A Caltech Library Service

Objects predict fixations better than early saliency

Einhäuser, Wolfgang and Spain, Merrielle and Perona, Pietro (2008) Objects predict fixations better than early saliency. Journal of Vision, 8 (14). pp. 1-26. ISSN 1534-7362. https://resolver.caltech.edu/CaltechAUTHORS:EINjov08b

[img]
Preview
PDF - Published Version
See Usage Policy.

2938Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:EINjov08b

Abstract

Humans move their eyes while looking at scenes and pictures. Eye movements correlate with shifts in attention and are thought to be a consequence of optimal resource allocation for high-level tasks such as visual recognition. Models of attention, such as “saliency maps,” are often built on the assumption that “early” features (color, contrast, orientation, motion, and so forth) drive attention directly. We explore an alternative hypothesis: Observers attend to “interesting” objects. To test this hypothesis, we measure the eye position of human observers while they inspect photographs of common natural scenes. Our observers perform different tasks: artistic evaluation, analysis of content, and search. Immediately after each presentation, our observers are asked to name objects they saw. Weighted with recall frequency, these objects predict fixations in individual images better than early saliency, irrespective of task. Also, saliency combined with object positions predicts which objects are frequently named. This suggests that early saliency has only an indirect effect on attention, acting through recognized objects. Consequently, rather than treating attention as mere preprocessing step for object recognition, models of both need to be integrated.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1167/8.14.18DOIArticle
ORCID:
AuthorORCID
Perona, Pietro0000-0002-7583-5809
Additional Information:© 2008 ARVO. Received January 15, 2008; published November 20, 2008. This material is based upon work supported under a National Science Foundation Graduate Research Fellowship, National Institute of Mental Health grant T32MH019138, Office of Naval Research grant N00014-06-1-0734, National Institutes of Health grant R01 DA022777, and Swiss National Science Foundation fellowship PA00A-111447.
Funders:
Funding AgencyGrant Number
NSF Graduate Research FellowshipUNSPECIFIED
NIH Predoctoral FellowshipT32MH019138
Office of Naval Research (ONR)N00014-06-1-0734
NIHR01 DA022777
Swiss National Science Foundation (SNSF)PA00A-111447
Subject Keywords:attention; eye movements; object recognition; scene recognition
Issue or Number:14
Record Number:CaltechAUTHORS:EINjov08b
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:EINjov08b
Official Citation:Einhäuser, W., Spain, M., & Perona, P. (2008). Objects predict fixations better than early saliency. Journal of Vision, 8(14):18, 1–26, http://journalofvision.org/8/14/18/, doi:10.1167/8.14.18.
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:13454
Collection:CaltechAUTHORS
Deposited By: Kristin Buxton
Deposited On:22 Apr 2009 21:07
Last Modified:30 Mar 2020 23:39

Repository Staff Only: item control page