A Caltech Library Service

Gaussian Multiresolution Models: Exploiting Sparse Markov and Covariance Structure

Choi, Myung Jin and Chandrasekaran, Venkat (2010) Gaussian Multiresolution Models: Exploiting Sparse Markov and Covariance Structure. IEEE Transactions on Signal Processing, 58 (3). pp. 1012-1024. ISSN 1053-587X.

PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


In this paper, we consider the problem of learning Gaussian multiresolution (MR) models in which data are only available at the finest scale, and the coarser, hidden variables serve to capture long-distance dependencies. Tree-structured MR models have limited modeling capabilities, as variables at one scale are forced to be uncorrelated with each other conditioned on other scales. We propose a new class of Gaussian MR models in which variables at each scale have sparse conditional covariance structure conditioned on other scales. Our goal is to learn a tree-structured graphical model connecting variables across scales (which translates into sparsity in inverse covariance), while at the same time learning sparse structure for the conditional covariance (not its inverse) within each scale conditioned on other scales. This model leads to an efficient, new inference algorithm that is similar to multipole methods in computational physics. We demonstrate the modeling and inference advantages of our approach over methods that use MR tree models and single-scale approximation methods that do not use hidden variables.

Item Type:Article
Related URLs:
URLURL TypeDescription
Additional Information:© 2010 IEEE. Manuscript received April 24, 2009; accepted September 22, 2009. First published November 06, 2009; current version published February 10, 2010. This work was supported in part by AFOSR under Grant FA9550-08-1-1080, in part by MURI under AFOSR Grant FA9550-06-1-0324, and in part by Shell International Exploration and Production, Inc. The work of M. J. Choi was supported in part by a Samsung Scholarship. A preliminary version of this work appeared in the Proceedings of the 26th Annual International Conference on Machine Learning (ICML 2009), Montreal, QC, Canada. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Mark J. Coates. The authors are with the Department of Electrical Engineering and Computer Science, Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA 02139 USA. The authors would like to thank Prof. H. Chen for helpful discussions about the stock returns example.
Funding AgencyGrant Number
Air Force Office of Scientific Research (AFOSR)FA9550-08-1-1080
Air Force Office of Scientific Research (AFOSR) Multidisciplinary University Research Initiative (MURI)FA9550-06-1-0324
Shell International Exploration and Production, Inc.UNSPECIFIED
Samsung ScholarshipUNSPECIFIED
Subject Keywords:Gauss-Markov random fields; graphical models; hidden variables; multipole methods; multiresolution (MR) models
Other Numbering System:
Other Numbering System NameOther Numbering System ID
INSPEC Accession Number11105857
Issue or Number:3
Record Number:CaltechAUTHORS:20121008-094406124
Persistent URL:
Official Citation:Myung Jin Choi; Chandrasekaran, V.; Willsky, A.S.; , "Gaussian Multiresolution Models: Exploiting Sparse Markov and Covariance Structure," Signal Processing, IEEE Transactions on , vol.58, no.3, pp.1012-1024, March 2010 doi: 10.1109/TSP.2009.2036042 URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:34744
Deposited By: Ruth Sustaita
Deposited On:08 Oct 2012 17:02
Last Modified:03 Oct 2019 04:21

Repository Staff Only: item control page