A Caltech Library Service

Predicting human gaze using low-level saliency combined with face detection

Cerf, Moran and Harel, Jonathan and Einhäuser, Wolfgang and Koch, Christof (2008) Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems, 20 . pp. 1-7. ISSN 1049-5258.

PDF (Moran NIPS 2007) - Published Version
See Usage Policy.

PDF (Slide) - Supplemental Material
See Usage Policy.

[img] Audio (MPEG) - Supplemental Material
See Usage Policy.

[img] Archive (ZIP) - Supplemental Material
See Usage Policy.


Use this Persistent URL to link to this item:


Under natural viewing conditions, human observers shift their gaze to allocate processing resources to subsets of the visual input. Many computational models try to predict such voluntary eye and attentional shifts. Although the important role of high level stimulus properties (e.g., semantic information) in search stands undisputed, most models are based on low-level image properties. We here demonstrate that a combined model of face detection and low-level saliency significantly outperforms a low-level model in predicting locations humans fixate on, based on eye-movement recordings of humans observing photographs of natural scenes, most of which contained at least one person. Observers, even when not instructed to look for anything particular, fixate on a face with a probability of over 80% within their first two fixations; furthermore, they exhibit more similar scanpaths when faces are present. Remarkably, our model’s predictive performance in images that do not contain faces is not impaired, and is even improved in some cases by spurious face detector responses.

Item Type:Article
Related URLs:
URLURL TypeDescription
Koch, Christof0000-0001-6482-8067
Contact Email
Group:Koch Laboratory (KLAB)
Record Number:CaltechAUTHORS:20130816-103345252
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:40642
Deposited By: KLAB Import
Deposited On:26 Jan 2008 09:55
Last Modified:11 Jan 2022 23:30

Repository Staff Only: item control page