CaltechAUTHORS
  A Caltech Library Service

Measuring and Predicting Importance of Objects in Our Visual World

Spain, Merrielle and Perona, Pietro (2007) Measuring and Predicting Importance of Objects in Our Visual World. California Institute of Technology , Pasadena, CA. (Unpublished) http://resolver.caltech.edu/CaltechAUTHORS:CNS-TR-2007-002

[img]
Preview
PDF - Submitted Version
See Usage Policy.

3256Kb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:CNS-TR-2007-002

Abstract

Associating keywords with images automatically is an approachable and useful goal for visual recognition researchers. Keywords are distinctive and informative objects. We argue that keywords need to be sorted by 'importance', which we define as the probability of being mentioned first by an observer. We propose a method for measuring the `importance' of words using the object labels that multiple human observers give an everyday scene photograph. We model object naming as drawing balls from an urn, and fit this model to estimate `importance'; this combines order and frequency, enabling precise prediction under limited human labeling. We explore the relationship between the importance of an object in a particular image and the area, centrality, and saliency of the corresponding image patches. Furthermore, our data shows that many words are associated with even simple environments, and that few frequently appearing objects are shared across environments.


Item Type:Report or Paper (Technical Report)
Related URLs:
URLURL TypeDescription
http://resolver.caltech.edu/CaltechAUTHORS:20110303-113534874Related ItemJournal Article
ORCID:
AuthorORCID
Perona, Pietro0000-0002-7583-5809
Subject Keywords:object recognition, complex scenes, indexing images, frequency, importance
Record Number:CaltechAUTHORS:CNS-TR-2007-002
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:CNS-TR-2007-002
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:9139
Collection:CaltechAUTHORS
Deposited By: Merrielle Spain
Deposited On:05 Nov 2007
Last Modified:27 Mar 2019 18:46

Repository Staff Only: item control page