Published April 2015 | Version Submitted
Journal Article Open

Robust Computation of Linear Models by Convex Relaxation

Abstract

Consider a data set of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called reaper, that can reliably fit a low-dimensional model to this type of data. This approach parameterizes linear subspaces using orthogonal projectors and uses a relaxation of the set of orthogonal projectors to reach the convex formulation. The paper provides an efficient algorithm for solving the reaper problem, and it documents numerical experiments that confirm that reaper can dependably find linear structure in synthetic and natural data. In addition, when the inliers lie near a low-dimensional subspace, there is a rigorous theory that describes when reaper can approximate this subspace.

Additional Information

© 2014 SFoCM. Received: 19 February 2012; Revised: 1 November 2013; Accepted: 16 June 2014; Published online: 23 September 2014. Lerman and Zhang were supported in part by the IMA and by NSF Grants DMS-09-15064 andDMS-09-56072.McCoy and Tropp were supported by Office of Naval Research (ONR) Awards N00014-08-1-0883 and N00014-11-1002, Air Force Office of Scientific Research (AFOSR) Award FA9550-09-1-0643, Defense Advanced Research Projects Agency (DARPA) Award N66001-08-1-2065, and a Sloan Research Fellowship. The authors thank Eran Halperin, Yi Ma, Ben Recht, Amit Singer, and John Wright for helpful conversations. The anonymous referees provided many thoughtful and incisive remarks that helped us improve the manuscript immensely.

Attached Files

Submitted - 1202.4044v2.pdf

Files

1202.4044v2.pdf

Files (1.9 MB)

Name Size Download all
md5:578f5efb8069ee8d91902654188d89c9
1.9 MB Preview Download

Additional details

Identifiers

Eprint ID
56730
DOI
10.1007/s10208-014-9221-0
Resolver ID
CaltechAUTHORS:20150416-134303719

Funding

IMA
NSF
DMS-09-15064
NSF
DMS-09-56072
Office of Naval Research (ONR)
N00014-08-1-0883
Office of Naval Research (ONR)
N00014-11-1002
Air Force Office of Scientific Research (AFOSR)
FA9550-09-1-0643
Defense Advanced Research Projects Agency (DARPA)
N66001-08-1-2065
Alfred P. Sloan Foundation

Dates

Created
2015-04-17
Created from EPrint's datestamp field
Updated
2021-11-10
Created from EPrint's last_modified field