Group Symmetry and Covariance Regularization
- Creators
- Shah, Parikshit
- Chandrasekaran, Venkat
Abstract
Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the notion of a symmetric model via group invariance. We propose projection onto a group fixed point subspace as a fundamental way of regularizing covariance matrices in the high- dimensional regime. In terms of parameters associated to the group we derive precise rates of convergence of the regularized covariance matrix and demonstrate that significant statistical gains may be expected in terms of the sample complexity. We further explore the consequences of symmetry on related model-selection problems such as the learning of sparse covariance and inverse covariance matrices. We also verify our results with simulations.
Additional Information
© 2012 Institute of Mathematical Statistics. Received November 2011. The authors would like to thank Pablo Parrilo, Benjamin Recht, Alan Willsky, and Stephen Wright for helpful discussions.Attached Files
Published - euclid.ejs.1348665230.pdf
Submitted - sc_groupsym_preprint11.pdf
Erratum - euclid.ejs.1386943912.pdf
Files
Additional details
- Eprint ID
- 34686
- Resolver ID
- CaltechAUTHORS:20121004-134807001
- Created
-
2012-10-04Created from EPrint's datestamp field
- Updated
-
2023-06-01Created from EPrint's last_modified field