CaltechAUTHORS
  A Caltech Library Service

Group Symmetry and Covariance Regularization

Shah, Parikshit and Chandrasekaran, Venkat (2012) Group Symmetry and Covariance Regularization. Electronic Journal of Statistics, 6 . pp. 1600-1640. ISSN 1935-7524. https://resolver.caltech.edu/CaltechAUTHORS:20121004-134807001

[img]
Preview
PDF - Published Version
See Usage Policy.

474kB
[img]
Preview
PDF - Submitted Version
See Usage Policy.

636kB
[img]
Preview
PDF - Erratum
See Usage Policy.

61kB

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20121004-134807001

Abstract

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the notion of a symmetric model via group invariance. We propose projection onto a group fixed point subspace as a fundamental way of regularizing covariance matrices in the high- dimensional regime. In terms of parameters associated to the group we derive precise rates of convergence of the regularized covariance matrix and demonstrate that significant statistical gains may be expected in terms of the sample complexity. We further explore the consequences of symmetry on related model-selection problems such as the learning of sparse covariance and inverse covariance matrices. We also verify our results with simulations.


Item Type:Article
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1214/12-EJS723DOIArticle
http://projecteuclid.org/DPubS?service=UI&version=1.0&verb=Display&handle=euclid.ejs/1348665230PublisherArticle
http://arxiv.org/abs/1111.7061arXivDiscussion Paper
http://dx.doi.org/10.1214/13-EJS871DOIErrata
Additional Information:© 2012 Institute of Mathematical Statistics. Received November 2011. The authors would like to thank Pablo Parrilo, Benjamin Recht, Alan Willsky, and Stephen Wright for helpful discussions.
Subject Keywords:Group invariance, covariance selection, exchange-ability, high dimensional asymptotics
Classification Code:AMS 2000 subject classifications: Primary 62F12, 62H12
Record Number:CaltechAUTHORS:20121004-134807001
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20121004-134807001
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:34686
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:04 Oct 2012 22:18
Last Modified:03 Oct 2019 04:21

Repository Staff Only: item control page