A Caltech Library Service

Similarity Comparisons for Interactive Fine-Grained Categorization

Wah, Catherine and Van Horn, Grant and Branson, Steve and Maji, Subhransu and Perona, Pietro and Belongie, Serge (2014) Similarity Comparisons for Interactive Fine-Grained Categorization. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE , Piscataway, NJ, pp. 859-866. ISBN 978-1-4799-5117-8.

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item:


Current human-in-the-loop fine-grained visual categorization systems depend on a predefined vocabulary of attributes and parts, usually determined by experts. In this work, we move away from that expert-driven and attribute-centric paradigm and present a novel interactive classification system that incorporates computer vision and perceptual similarity metrics in a unified framework. At test time, users are asked to judge relative similarity between a query image and various sets of images, these general queries do not require expert-defined terminology and are applicable to other domains and basic-level categories, enabling a flexible, efficient, and scalable system for fine-grained categorization with humans in the loop. Our system outperforms existing state-of-the-art systems for relevance feedback-based image retrieval as well as interactive classification, resulting in a reduction of up to 43% in the average number of questions needed to correctly classify an image.

Item Type:Book Section
Related URLs:
URLURL TypeDescription DOIArticle
Perona, Pietro0000-0002-7583-5809
Belongie, Serge0000-0002-0388-5217
Additional Information:© 2014 IEEE. The authors thank the reviewers for their helpful feedback. This work is supported by the Google Focused Research Award and the National Science Foundation Graduate Research Fellowship under Grant No. DGE0707423.
Funding AgencyGrant Number
Google Focused Research AwardUNSPECIFIED
NSF Graduate Research FellowshipDGE0707423
Record Number:CaltechAUTHORS:20151023-152949167
Persistent URL:
Official Citation:Wah, C.; Van Horn, G.; Branson, S.; Maji, S.; Perona, P.; Belongie, S., "Similarity Comparisons for Interactive Fine-Grained Categorization," in Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on , vol., no., pp.859-866, 23-28 June 2014 doi: 10.1109/CVPR.2014.115
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:61512
Deposited By: Tony Diaz
Deposited On:26 Oct 2015 20:47
Last Modified:09 Mar 2020 13:18

Repository Staff Only: item control page