CaltechAUTHORS
  A Caltech Library Service

A prototype knockoff filter for group selection with FDR control

Chen, Jiajie and Hou, Anthony and Hou, Thomas Y. (2020) A prototype knockoff filter for group selection with FDR control. Information and Inference, 9 (2). pp. 271-288. ISSN 2049-8772. https://resolver.caltech.edu/CaltechAUTHORS:20200124-145020991

[img] PDF - Submitted Version
See Usage Policy.

244Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20200124-145020991

Abstract

In many applications, we need to study a linear regression model that consists of a response variable and a large number of potential explanatory variables, and determine which variables are truly associated with the response. In Foygel Barber & Candès (2015, Ann. Statist., 43, 2055–2085), the authors introduced a new variable selection procedure called the knockoff filter to control the false discovery rate (FDR) and proved that this method achieves exact FDR control. In this paper, we propose a prototype knockoff filter for group selection by extending the Reid–Tibshirani (2016, Biostatistics, 17, 364–376) prototype method. Our prototype knockoff filter improves the computational efficiency and statistical power of the Reid–Tibshirani prototype method when it is applied for group selection. In some cases when the group features are spanned by one or a few hidden factors, we demonstrate that the Principal Component Analysis (PCA) prototype knockoff filter outperforms the Dai–Foygel Barber (2016, 33rd International Conference on Machine Learning (ICML 2016)) group knockoff filter. We present several numerical experiments to compare our prototype knockoff filter with the Reid–Tibshirani prototype method and the group knockoff filter. We have also conducted some analysis of the knockoff filter. Our analysis reveals that some knockoff path method statistics, including the Lasso path statistic, may lead to loss of power for certain design matrices and a specially designed response even if their signal strengths are still relatively strong.


Item Type:Article
Related URLs:
URLURL TypeDescription
https://doi.org/10.1093/imaiai/iaz012DOIArticle
https://arxiv.org/abs/1706.03400arXivDiscussion Paper
Alternate Title:Some Analysis of the Knockoff Filter and its Variants
Additional Information:© 2019 The Author(s). Published by Oxford University Press on behalf of the Institute of Mathematics and its Applications. Received: 11 June 2017; Revision received: 22 April 2018; Accepted: 24 April 2019; Published: 11 July 2019. The first author’s research was conducted during his visit to Applied and Computational Mathematics (ACM) at California Institute of Technology. We are very thankful for Prof. Emmanuel Candés’ valuable comments and suggestions to our work. We also thank Prof. Rina Foygel Barber for communicating with us regarding her group knockoff filter and Dr. Lucas Janson for his insightful comments on our PCA prototype filter. We are grateful to the anonymous referees for their valuable comments and suggestions and for pointing out a potential problem in a numerical example in our earlier manuscript using the glmnet package in solving the Lasso problem. Funding: National Science Foundation (DMS 1318377 and DMS 1613861).
Funders:
Funding AgencyGrant Number
NSFDMS-1318377
NSFDMS-1613861
Subject Keywords:variable selection; false discovery rate (FDR); group variable selection; knockoff filter; linear regression
Issue or Number:2
Record Number:CaltechAUTHORS:20200124-145020991
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20200124-145020991
Official Citation:Jiajie Chen, Anthony Hou, Thomas Y Hou, A prototype knockoff filter for group selection with FDR control, Information and Inference: A Journal of the IMA, 9(2): 271-288. June 2020; doi: 10.1093/imaiai/iaz012
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:100909
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:25 Jan 2020 03:25
Last Modified:02 Jun 2020 17:52

Repository Staff Only: item control page