A Caltech Library Service

Active Annotation Translation

Branson, Steve and Hjörleifsson, Kristján Eldjárn and Perona, Pietro (2014) Active Annotation Translation. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE , Piscataway, NJ, pp. 3702-3709. ISBN 978-1-4799-5117-8.

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item:


We introduce a general framework for quickly annotating an image dataset when previous annotations exist. The new annotations (e.g. part locations) may be quite different from the old annotations (e.g. segmentations). Human annotators may be thought of as helping translate the old annotations into the new ones. As annotators label images, our algorithm incrementally learns a translator from source to target labels as well as a computer-vision-based structured predictor. These two components are combined to form an improved prediction system which accelerates the annotators' work through a smart GUI. We show how the method can be applied to translate between a wide variety of annotation types, including bounding boxes, segmentations, 2D and 3D part-based systems, and class and attribute labels. The proposed system will be a useful tool toward exploring new types of representations beyond simple bounding boxes, object segmentations, and class labels, and toward finding new ways to exploit existing large datasets with traditional types of annotations like SUN [36], Image Net [11], and Pascal VOC [12]. Experiments on the CUB-200-2011 and H3D datasets demonstrate 1) our method accelerates collection of part annotations by a factor of 3-20 compared to manual labeling, 2) our system can be used effectively in a scheme where definitions of part, attribute, or action vocabularies are evolved interactively without relabeling the entire dataset, and 3) toward collecting pose annotations, segmentations are more useful than bounding boxes, and part-level annotations are more effective than segmentations.

Item Type:Book Section
Related URLs:
URLURL TypeDescription DOIArticle
Perona, Pietro0000-0002-7583-5809
Additional Information:© 2014 IEEE. Funding for this work was provided by the Google Focused Research Award.
Funding AgencyGrant Number
Google Focused Research AwardUNSPECIFIED
Record Number:CaltechAUTHORS:20151023-145843967
Persistent URL:
Official Citation:Branson, S.; Hjorleifsson, K.E.; Perona, P., "Active Annotation Translation," in Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on , vol., no., pp.3702-3709, 23-28 June 2014 doi: 10.1109/CVPR.2014.473
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:61510
Deposited By: Tony Diaz
Deposited On:26 Oct 2015 20:49
Last Modified:03 Oct 2019 09:08

Repository Staff Only: item control page