A Caltech Library Service

Real-Time Adaptive Video Compression

Schaeffer, Hayden and Yang, Yi and Zhao, Hongkai and Osher, Stanley (2015) Real-Time Adaptive Video Compression. SIAM Journal on Scientific Computing, 37 (6). B980-B1001. ISSN 1064-8275. doi:10.1137/130937792.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


Compressive sensing has been widely applied to problems in signal and imaging processing. In this work, we present an algorithm for predicting optimal real-time compression rates for video. The video data we consider is spatially compressed during the acquisition process, unlike in many of the standard methods. Rather than temporally compressing the frames at a fixed rate, our algorithm adaptively predicts the compression rate given the behavior of a few previous compressed frames. The algorithm uses polynomial fitting and simple filters, making it computationally feasible and easy to implement in hardware. Based on numerical simulations of real videos, the algorithm is able to capture object motion and approximate dynamics within the compressed frames. The adaptive video compression improves the quality of the reconstructed video (as compared to an equivalent fixed rate compression scheme) by several dB of peak signal-to-noise ratio without increasing the amount of information stored, as seen in numerical simulations presented here.

Item Type:Article
Related URLs:
URLURL TypeDescription
Additional Information:© 2015 Society for Industrial and Applied Mathematics. Submitted to the journal’s Computational Methods in Science and Engineering section September 20, 2013; accepted for publication (in revised form) February 27, 2015; published electronically December 22, 2015. Department of Computing and Mathematical Sciences, Caltech, Pasadena, CA 91125 (hschaeffer The research of this author was supported by NSF grant 1303892, by the University of California President’s Postdoctoral Fellowship Program, and by the Department of Defense (DoD) through the National Defense Science and Engineering Graduate Fellowship (NDSEG). Department of Mathematics, University of California, Los Angeles, Los Angeles, CA 90095 ( The research of this author was supported by NSF DMS 0835863, by NSF DMS 0914561, and by ONR N00014-11-0749. Department of Mathematics, University of California at Irvine, Irvine, CA 92697-3875 ( The research of this author was supported by ONR grant N00014-11-1-0602 and by NSF DMS-1418422. The authors would like to thank Wotao Yin and Tom Goldstein for their useful discussions. The authors would also like to thank Lawrence Carin, Guillermo Sapiro, David Brady, Giang Tran, Jianbo Yang, Xin Yuan, and the anonymous reviewers for their helpful discussions and comments.
Funding AgencyGrant Number
University of CaliforniaUNSPECIFIED
Department of Energy (DOE)UNSPECIFIED
NSFDMS 0835863
NSFDMS 0914561
Office of Naval Research (ONR)N00014-11-0749
Office of Naval Research (ONR)N00014-11-1-0602
National Defense Science and Engineering Graduate (NDSEG) FellowshipUNSPECIFIED
Subject Keywords:compressive sensing, video compression, adaptive polynomial fitting, extrapolation, optical flow, patch-based methods
Issue or Number:6
Classification Code:AMS subject classifications. 94A08, 65Y99, 94A12
Record Number:CaltechAUTHORS:20160115-125143091
Persistent URL:
Official Citation:Real-Time Adaptive Video Compression Hayden Schaeffer, Yi Yang, Hongkai Zhao, and Stanley Osher SIAM Journal on Scientific Computing 2015 37:6, B980-B1001
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:63717
Deposited By: Ruth Sustaita
Deposited On:15 Jan 2016 22:42
Last Modified:10 Nov 2021 23:20

Repository Staff Only: item control page