CaltechAUTHORS
  A Caltech Library Service

A pseudo knockoff filter for correlated features

Chen, Jiajie and Hou, Anthony and Hou, Thomas Y. (2019) A pseudo knockoff filter for correlated features. Information and Inference, 8 (2). pp. 313-341. ISSN 2049-8772. https://resolver.caltech.edu/CaltechAUTHORS:20191114-104110525

[img] PDF - Submitted Version
See Usage Policy.

334Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20191114-104110525

Abstract

In Barber & Candès (2015, Ann. Statist., 43, 2055–2085), the authors introduced a new variable selection procedure called the knockoff filter to control the false discovery rate (FDR) and proved that this method achieves exact FDR control. Inspired by the work by Barber & Candès (2015, Ann. Statist., 43, 2055–2085), we propose a pseudo knockoff filter that inherits some advantages of the original knockoff filter and has more flexibility in constructing its knockoff matrix. Moreover, we perform a number of numerical experiments that seem to suggest that the pseudo knockoff filter with the half Lasso statistic has FDR control and offers more power than the original knockoff filter with the Lasso Path or the half Lasso statistic for the numerical examples that we consider in this paper. Although we cannot establish rigourous FDR control for the pseudo knockoff filter, we provide some partial analysis of the pseudo knockoff filter with the half Lasso statistic and establish a uniform false discovery proportion bound and an expectation inequality.


Item Type:Article
Related URLs:
URLURL TypeDescription
https://doi.org/10.1093/imaiai/iay012DOIArticle
https://arxiv.org/abs/1708.09305arXivDiscussion Paper
Additional Information:© 2018 The Author(s). Published by Oxford University Press on behalf of the Institute of Mathematics and its Applications. This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model). Received on 30 August 2017; revised on 14 May 2018; accepted on 7 June 2018. Published: 17 July 2018. The research of J.C. was performed during his visit to ACM at Caltech. We would like to thank Professor Emmanuel Candes for his many valuable comments and suggestions to our work. We would also like to thank Professor Lucas Janson for his interest and comments on the earlier version of this manuscript and Dr. Pengfei Liu for the discussions on the pseudo knockoff. Funding: National Science Foundation (DMS 1318377 and DMS 1613861).
Funders:
Funding AgencyGrant Number
NSFDMS-1318377
NSFDMS-1613861
Subject Keywords:knockoff filter; feature selection; FDR control; correlated features
Issue or Number:2
Record Number:CaltechAUTHORS:20191114-104110525
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20191114-104110525
Official Citation:Jiajie Chen, Anthony Hou, Thomas Y Hou, A pseudo knockoff filter for correlated features, Information and Inference: A Journal of the IMA, Volume 8, Issue 2, June 2019, Pages 313–341, https://doi.org/10.1093/imaiai/iay012
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:99835
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:14 Nov 2019 21:31
Last Modified:23 Jan 2020 21:24

Repository Staff Only: item control page