CaltechAUTHORS
  A Caltech Library Service

Learning Online Smooth Predictors for Realtime Camera Planning using Recurrent Decision Trees

Chen, Jianhui and Le, Hoang M. and Carr, Peter and Yue, Yisong and Little, James J. (2016) Learning Online Smooth Predictors for Realtime Camera Planning using Recurrent Decision Trees. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition. IEEE , Piscataway, NJ, pp. 4688-4696. ISBN 978-1-4673-8851-1 http://resolver.caltech.edu/CaltechAUTHORS:20160628-154742818

[img] PDF - Submitted Version
See Usage Policy.

1409Kb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20160628-154742818

Abstract

We study the problem of online prediction for realtime camera planning, where the goal is to predict smooth trajectories that correctly track and frame objects of interest (e.g., players in a basketball game). The conventional approach for training predictors does not directly consider temporal consistency, and often produces undesirable jitter. Although post-hoc smoothing (e.g., via a Kalman filter) can mitigate this issue to some degree, it is not ideal due to overly stringent modeling assumptions (e.g., Gaussian noise). We propose a recurrent decision tree framework that can directly incorporate temporal consistency into a data-driven predictor, as well as a learning algorithm that can efficiently learn such temporally smooth models. Our approach does not require any post-processing, making online smooth predictions much easier to generate when the noise model is unknown. We apply our approach to sports broadcasting: given noisy player detections, we learn where the camera should look based on human demonstrations. Our experiments exhibit significant improvements over conventional baselines and showcase the practicality of our approach.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1109/CVPR.2016.507DOIArticle
http://ieeexplore.ieee.org/document/7780876/PublisherArticle
https://www.disneyresearch.com/publication/realtime-camera-planning/OrganizationArticle
Additional Information:© 2016 IEEE.
Record Number:CaltechAUTHORS:20160628-154742818
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20160628-154742818
Official Citation:J. Chen, H. M. Le, P. Carr, Y. Yue and J. J. Little, "Learning Online Smooth Predictors for Realtime Camera Planning Using Recurrent Decision Trees," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016, pp. 4688-4696. doi: 10.1109/CVPR.2016.507 URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7780876&isnumber=7780329
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:68721
Collection:CaltechAUTHORS
Deposited By: Joy Painter
Deposited On:28 Jun 2016 23:01
Last Modified:25 May 2017 16:17

Repository Staff Only: item control page