Enhancing Sparsity by Reweighted ℓ(1) Minimization
Abstract
It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained ℓ1 minimization. In this paper, we study a novel method for sparse signal recovery that in many situations outperforms ℓ1 minimization in the sense that substantially fewer measurements are needed for exact recovery. The algorithm consists of solving a sequence of weighted ℓ1-minimization problems where the weights used for the next iteration are computed from the value of the current solution. We present a series of experiments demonstrating the remarkable performance and broad applicability of this algorithm in the areas of sparse signal recovery, statistical estimation, error correction and image processing. Interestingly, superior gains are also achieved when our method is applied to recover signals with assumed near-sparsity in overcomplete representations—not by reweighting the ℓ1 norm of the coefficient sequence as is common, but by reweighting the ℓ1 norm of the transformed object. An immediate consequence is the possibility of highly efficient data acquisition protocols by improving on a technique known as Compressive Sensing.
Additional Information
© 2008 Springer. Received: 10 October 2007 Published online: 15 October 2008. Communicated by Albert Cohen. E.C. was partially supported by a National Science Foundation grant CCF-515362, by the 2006 Waterman Award (NSF) and by a grant from DARPA. This work was performed while M.W. was an NSF Postdoctoral Fellow (NSF DMS-0603606) in the Department of Applied and Computational Mathematics at Caltech. S.B. was partially supported by NSF award 0529426, NASA award NNX07AEIIA, and AFOSR awards FA9550-06-1-0514 and FA9550-06-1-0312. We would like to thank Nathaniel Braun and Peter Stobbe for fruitful discussions about this project. Parts of this work were presented at the Fourth IEEE International Symposium on Biomedical Imaging (ISBI '07) held April 12–15, 2007 and at the Von Neumann Symposium on Sparse Representation and High-Dimensional Geometry held July 8–12, 2007. Related work was first developed as lecture notes for the course EE364b: Convex Optimization II, given at Stanford Winter quarter 2006-07 [62].Attached Files
Submitted - 0711.1612.pdf
Files
Name | Size | Download all |
---|---|---|
md5:4b294f30e39be8ca3c6aa82590abd8c1
|
552.6 kB | Preview Download |
Additional details
- Eprint ID
- 12852
- DOI
- 10.1007/s00041-008-9045-x
- Resolver ID
- CaltechAUTHORS:CANjfaa08
- NSF
- CCF-515362
- Defense Advanced Research Projects Agency (DARPA)
- NSF
- DMS-0603606
- NSF
- DMS-0529426
- NASA
- NNX07AEIIA
- Air Force Office of Scientific Research (AFOSR)
- FA9550-06-1-0514
- Air Force Office of Scientific Research (AFOSR)
- FA9550-06-1-0312
- Created
-
2009-01-08Created from EPrint's datestamp field
- Updated
-
2021-11-08Created from EPrint's last_modified field