CaltechAUTHORS
  A Caltech Library Service

Benchmarking and Error Diagnosis in Multi-instance Pose Estimation

Ronchi, Matteo Ruggero and Perona, Pietro (2017) Benchmarking and Error Diagnosis in Multi-instance Pose Estimation. In: 2017 IEEE International Conference on Computer Vision (ICCV). IEEE , Piscataway, NJ, pp. 369-378. ISBN 978-1-5386-1032-9. http://resolver.caltech.edu/CaltechAUTHORS:20180314-141340921

[img] PDF - Submitted Version
See Usage Policy.

5Mb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20180314-141340921

Abstract

We propose a new method to analyze the impact of errors in algorithms for multi-instance pose estimation and a principled benchmark that can be used to compare them. We define and characterize three classes of errors - localization, scoring, and background - study how they are influenced by instance attributes and their impact on an algorithm's performance. Our technique is applied to compare the two leading methods for human pose estimation on the COCO Dataset, measure the sensitivity of pose estimation with respect to instance size, type and number of visible keypoints, clutter due to multiple instances, and the relative score of instances. The performance of algorithms, and the types of error they make, are highly dependent on all these variables, but mostly on the number of keypoints and the clutter. The analysis and software tools we propose offer a novel and insightful approach for understanding the behavior of pose estimation algorithms and an effective method for measuring their strengths and weaknesses.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
https://doi.org/10.1109/ICCV.2017.48DOIArticle
http://ieeexplore.ieee.org/document/8237310PublisherArticle
https://arxiv.org/abs/1707.05388arXivDiscussion Paper
ORCID:
AuthorORCID
Perona, Pietro0000-0002-7583-5809
Additional Information:© 2017 IEEE.
Record Number:CaltechAUTHORS:20180314-141340921
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20180314-141340921
Official Citation:M. R. Ronchi and P. Perona, "Benchmarking and Error Diagnosis in Multi-instance Pose Estimation," 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 2017, pp. 369-378. doi: 10.1109/ICCV.2017.48 URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8237310&isnumber=8237262
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:85312
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:15 Mar 2018 03:34
Last Modified:15 Mar 2018 03:34

Repository Staff Only: item control page