Suppose we lhave n observationis ftom Y= X+ c, where e is nieasuremiienit error with kiowin distributioni, and the denesity f of X is uniknowii withi thte nloln-paraniietric conistrainit

Big data is transforming our world, revolutionizing operations and analytics everywhere, from financial engineering to biomedical sciences. The complexity of big data often makes dimension reduction techniques necessary before conducting statistical inference. Principal component analysis, commonly referred to as PCA, has become an essential tool for multivariate data analysis and unsupervised dimension reduction, the goal of which is to find a lower dimensional subspace that captures most of the variation in the dataset. This article provides an overview of methodological and theoretical developments of PCA over the past decade, with focus on its applications to big data analytics. We first review the mathematical formulation of PCA and its theoretical development from the view point of perturbation analysis. We then briefly discuss the relationship between PCA and factor analysis as well as its applications to

No abstract uploaded!

High-dimensional linear regression has been intensively studied in the community of statistics in the last two decades. For convenience of theoretical analyses, classical methods usually assume independent observations and subGaussian-tailed errors. However, neither of them hold in many real high-dimensional time-series data. Recently [Sun, Zhou, Fan, 2019, J. Amer. Stat. Assoc., in press] proposed Adaptive Huber Regression (AHR) to address the issue of heavy-tailed errors. They discover that the robustification parameter of the Huber loss should adapt to the sample size, the dimensionality and (1+\delta) -moments of the heavy-tailed errors. We progress in a vertical direction and justify AHR on dependent observations. Specially, we consider an important dependence structure---Markov dependence. Our results show that the Markov dependence impacts on the adaption of the robustification parameter and the estimation of regression coefficients in the way that the sample size should be discounted by a factor depending on the spectral gap of the underlying Markov chain.

Ultrahigh-dimensional variable selection plays an increasingly important role in contemporary scientific discoveries and statistical research. Among others, Fan and Lv [JR Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849911] propose an independent screening framework by ranking the marginal correlations. They showed that the correlation ranking procedure possesses a sure independence screening property within the context of the linear model with Gaussian covariates and responses. In this paper, we propose a more general version of the independent learning with ranking the maximum marginal likelihood estimates or the maximum marginal likelihood itself in generalized linear models. We show that the proposed methods, with Fan and Lv [JR Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849911] as a very special case, also possess the sure screening property with vanishing false selection rate. The