On the principal components of sample covariance matrices

Alex Bloemendal Harvard University Antti Knowles ETH Zurich Horng-Tzer Yau Harvard University Jun Yin University of Wisconsin

Probability mathscidoc:1608.28005

Probability Theory and Related Fields, 164, (1), 459–552, 2016.2
We introduce a class of M×M sample covariance matrices Q which subsumes and generalizes several previous models. The associated population covariance matrix Σ=EQ is assumed to differ from the identity by a matrix of bounded rank. All quantities except the rank of Σ−IM may depend on M in an arbitrary fashion. We investigate the principal components, i.e.\ the top eigenvalues and eigenvectors, of Q. We derive precise large deviation estimates on the generalized components ⟨w,ξi⟩ of the outlier and non-outlier eigenvectors ξi. Our results also hold near the so-called BBP transition, where outliers are created or annihilated, and for degenerate or near-degenerate outliers. We believe the obtained rates of convergence to be optimal. In addition, we derive the asymptotic distribution of the generalized components of the non-outlier eigenvectors. A novel observation arising from our results is that, unlike the eigenvalues, the eigenvectors of the principal components contain information about the \emph{subcritical} spikes of Σ. The proofs use several results on the eigenvalues and eigenvectors of the uncorrelated matrix Q, satisfying EQ=IM, as input: the isotropic local Marchenko-Pastur law established in [9], level repulsion, and quantum unique ergodicity of the eigenvectors. The latter is a special case of a new universality result for the joint eigenvalue-eigenvector distribution.
principal components, covariance matrice
[ Download ] [ 2016-08-23 11:45:53 uploaded by yinjun ] [ 1254 downloads ] [ 0 comments ] [ Cited by 4 ]
  title={On the principal components of sample covariance matrices},
  author={Alex Bloemendal, Antti Knowles, Horng-Tzer Yau, and Jun Yin},
  booktitle={Probability Theory and Related Fields},
Alex Bloemendal, Antti Knowles, Horng-Tzer Yau, and Jun Yin. On the principal components of sample covariance matrices. 2016. Vol. 164. In Probability Theory and Related Fields. pp.459–552. http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20160823114553921529399.
Please log in for comment!
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved