CaltechAUTHORS
  A Caltech Library Service

Sufficient Dimension Reduction and Modeling Responses Conditioned on Covariates: An Integrated Approach via Convex Optimization

Taeb, Armeen and Chandrasekaran, Venkat (2015) Sufficient Dimension Reduction and Modeling Responses Conditioned on Covariates: An Integrated Approach via Convex Optimization. . (Submitted) http://resolver.caltech.edu/CaltechAUTHORS:20170614-101104339

[img] PDF - Submitted Version
See Usage Policy.

661Kb

Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20170614-101104339

Abstract

Given observations of a collection of covariates and responses (Y,X) ∈ R^p × R^q, sufficient dimension reduction (SDR) techniques aim to identify a mapping f: R^q → R^k with k ≪ q such that Y|f(X) is independent of X. The image f(X) summarizes the relevant information in a potentially large number of covariates X that influence the responses Y. In many contemporary settings, the number of responses p is also quite large, in addition to a large number q of covariates. This leads to the challenge of fitting a succinctly parameterized statistical model to Y|f(X), which is a problem that is usually not addressed in a traditional SDR framework. In this paper, we present a computationally tractable convex relaxation based estimator for simultaneously (a) identifying a linear dimension reduction f(X) of the covariates that is sufficient with respect to the responses, and (b) fitting several types of structured low-dimensional models-factor models, graphical models, latent-variable graphical models - to the conditional distribution of Y|f(X). We analyze the consistency properties of our estimator in a high-dimensional scaling regime. We also illustrate the performance of our approach on a newsgroup dataset and on a dataset consisting of financial asset prices.


Item Type:Report or Paper (Discussion Paper)
Related URLs:
URLURL TypeDescription
https://arxiv.org/abs/1508.03852arXivDiscussion Paper
ORCID:
AuthorORCID
Taeb, Armeen0000-0002-5647-3160
Additional Information:Submitted on 16 Aug 2015 (v1), last revised 18 Aug 2015 (this version, v2)
Record Number:CaltechAUTHORS:20170614-101104339
Persistent URL:http://resolver.caltech.edu/CaltechAUTHORS:20170614-101104339
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:78201
Collection:CaltechAUTHORS
Deposited By: Ruth Sustaita
Deposited On:14 Jun 2017 17:55
Last Modified:27 Nov 2017 21:27

Repository Staff Only: item control page