Sparse PCA: Optimal rates and adaptive estimation

T. Tony Cai University of Pennsylvania Zongming Ma University of Pennsylvania Yihong Wu University of Illinois at Urbana-Champaign

Statistics Theory and Methods mathscidoc:1706.33001

Distinguished Paper Award in 2017

The Annals of Statistics, 41, (6), 2013
Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional setting. Under mild technical conditions, we first establish optimal rates of convergence for estimating the principal subspace which sharp with respect to all the parameters, thus providing a complete character ization of the difficulty of the estimation problem in term of the convergence rate. The lower bound is obtained by calculating the local metric entropy an application of Fano's lemma. The rate optimal estimator is constructed using aggregation, which, however, might not be computationally feasible. We then introduce an adaptive procedure for estimating the principal sub space which is fully data driven and can be computed efficiently. It is shown that the estimator attains the optimal rates of convergence simultaneously over a large collection of the parameter spaces. A key idea in our construc tion is a reduction scheme which reduces the sparse PCA problem to a high dimensional multivariate regression problem. This method is potentially useful for other related
No keywords uploaded!
[ Download ] [ 2017-06-02 14:34:42 uploaded by yauawardadmin ] [ 1060 downloads ] [ 0 comments ]
@inproceedings{t.2013sparse,
  title={Sparse PCA: Optimal rates and adaptive estimation},
  author={T. Tony Cai, Zongming Ma, and Yihong Wu},
  url={http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20170602143442103124787},
  booktitle={The Annals of Statistics},
  volume={41},
  number={6},
  year={2013},
}
T. Tony Cai, Zongming Ma, and Yihong Wu. Sparse PCA: Optimal rates and adaptive estimation. 2013. Vol. 41. In The Annals of Statistics. http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20170602143442103124787.
Please log in for comment!
 
 
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved