CaltechAUTHORS
  A Caltech Library Service

Predicting human gaze using low-level saliency combined with face detection

Cerf, Moran and Harel, Jonathan and Einhäuser, Wolfgang and Koch, Christof (2008) Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems , 20 . pp. 1-7. ISSN 1049-5258. http://books.nips.cc/papers/files/nips20/NIPS2007_1074.pdf

[img]
Preview
PDF (Moran NIPS 2007) - Published Version
See Usage Policy.

2460Kb
[img]
Preview
PDF (Slide) - Supplemental Material
See Usage Policy.

2943Kb
[img] Audio (MPEG) - Supplemental Material
See Usage Policy.

702Kb
[img] Archive (ZIP) - Supplemental Material
See Usage Policy.

5Mb

Use this Persistent URL to link to this item: http://books.nips.cc/papers/files/nips20/NIPS2007_1074.pdf

Abstract

Under natural viewing conditions, human observers shift their gaze to allocate processing resources to subsets of the visual input. Many computational models try to predict such voluntary eye and attentional shifts. Although the important role of high level stimulus properties (e.g., semantic information) in search stands undisputed, most models are based on low-level image properties. We here demonstrate that a combined model of face detection and low-level saliency significantly outperforms a low-level model in predicting locations humans fixate on, based on eye-movement recordings of humans observing photographs of natural scenes, most of which contained at least one person. Observers, even when not instructed to look for anything particular, fixate on a face with a probability of over 80% within their first two fixations; furthermore, they exhibit more similar scanpaths when faces are present. Remarkably, our model’s predictive performance in images that do not contain faces is not impaired, and is even improved in some cases by spurious face detector responses.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://www.klab.caltech.edu/~moranAuthorUNSPECIFIED
http://books.nips.cc/nips20.htmlPublisherConference proceedings preface
Contact Email Address:moran@klab.caltech.edu
Group:Koch Laboratory, KLAB
Record Number:CaltechAUTHORS:20130816-103345252
Persistent URL:http://books.nips.cc/papers/files/nips20/NIPS2007_1074.pdf
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:40642
Collection:CaltechAUTHORS
Deposited By: KLAB Import
Deposited On:26 Jan 2008 09:55
Last Modified:27 Aug 2013 23:25

Repository Staff Only: item control page