MathSciDoc: An Archive for Mathematician ∫

Principal component analysis (PCA) is fundamental to statistical machine learning. It extracts latent principal factors that contribute to the most variation of the data. When data are stored across multiple machines, however, communication cost can prohibit the computation of PCA in a central location and distributed algorithms for PCA are thus needed. This paper proposes and studies a distributed PCA algorithm: each node machine computes the top K eigenvectors and transmits them to the central server; the central server then aggregates the information from all the node machines and conducts a PCA based on the aggregated information. We investigate the bias and variance for the resulting distributed estimator of the top K eigenvectors. In particular, we show that for distributions with symmetric innovation, the empirical top eigenspaces are unbiased, and hence the distributed PCA is unbiased. We derive the

Multiple hypothesis testing is a fundamental problem in high dimensional inference, with wide applications in many scientific fields. In genome-wide association studies, tens of thousands of tests are performed simultaneously to find if any genes are associated with some traits and those tests are correlated. When test statistics are correlated, false discovery control becomes very challenging under arbitrary dependence. In the current paper, we propose a new methodology based on principal factor approximation, which successfully substracts the common dependence and weakens significantly the correlation structure, to deal with an arbitrary dependence structure. We derive the theoretical distribution for false discovery proportion (FDP) in large scale multiple testing when a common threshold is used and provide a consistent FDP. This result has important applications in controlling FDR and FDP. Our estimate of FDP compares favorably with Efron (2007)'s approach, as demonstrated by in the simulated examples. Our approach is further illustrated by some real data applications.

We propose several statistics to test the Markov hypothesis for -mixing stationary processes sampled at discrete time intervals. Our tests are based on the ChapmanKolmogorov equation. We establish the asymptotic null distributions of the proposed test statistics, showing that Wilkss phenomenon holds. We compute the power of the test and provide simulations to investigate the finite sample performance of the test statistics when the null model is a diffusion process, with alternatives consisting of models with a stochastic mean reversion level, stochastic volatility and jumps.

Problems of nonparametric ltering arises frequently in engineering and nancial economics. Nonparametric lters often involve some ltering parameters to choose. These parameters can be chosen to optimize the performance locally at each time point or globally over a time interval. In this article, the ltering parameters are chosen via minimizing the prediction error for a large class of lters. Under a general martingale setting, with mild conditions on the time series structure and virtually no assumption on lters, we show that the adaptive lter with ltering parameter chosen by historical data performs nearly as well as the one with the ideal lter in the class, in terms of ltering errors. The theoretical result is also veri ed via intensive simulations. Our approach is also useful for choosing the orders of parametric models such as AR or GARCH processes. It can also be applied to volatility estimation in nancial economics. We illustrate the proposed methods by estimating the volatility of the returns of the S&P500 index and the yields of the three-month Treasury bills.

Macrophages play an important role in the inflammatory responses involved with spinal cord injury (SCI). We have previously demonstrated that infiltrated bone marrow-derived macrophages (BMDMs) engulf myelin debris, forming myelin-laden macrophages (mye-M). These mye-M promote disease progression through their pro-inflammatory phenotype, enhanced neurotoxicity, and impaired phagocytic capacity for apoptotic cells. We thus hypothesize that the excessive accumulation of mye-M is the root of secondary injury, and that targeting mye-M represents an efficient strategy to improve the local inflammatory microenvironment in injured spinal cords and to further motor neuron function recovery. In this study, we administer murine embryonic stem cell conditioned media (ESC-M) as a cell-free stem cell based therapy to treat a mouse model of SCI. We showed that BMDMs, but not microglial cells, engulf myelin debris generated at the injury site. Phagocytosis of myelin debris leads to the formation of mye-M in the injured spinal cord, which are surrounded by activated microglia cells. These mye-M are pro-inflammatory and lose the normal macrophage phagocytic capacity for apoptotic cells. We therefore focus on how to trigger lipid efflux from mye-M and thus restore their function. Using ESC-M as an immune modulating treatment for inflammatory damage after SCI, we rescued mye-M function and improved functional locomotor recovery. ESC-M treatment on mye-M resulted in improved exocytosis of internalized lipids and a normal capacity for apoptotic cell phagocytosis. Furthermore, when ESC-M was administered

<b>Motivation:</b> Normalization of microarray data is essential for multiple-array analyses. Several normalization protocols have been proposed based on different biological or statistical assumptions. A fundamental problem arises whether they have effectively normalized arrays. In addition, for a given array, the question arises how to choose a method to most effectively normalize the microarray data.

Big data is transforming our world, revolutionizing operations and analytics everywhere, from financial engineering to biomedical sciences. The complexity of big data often makes dimension reduction techniques necessary before conducting statistical inference. Principal component analysis, commonly referred to as PCA, has become an essential tool for multivariate data analysis and unsupervised dimension reduction, the goal of which is to find a lower dimensional subspace that captures most of the variation in the dataset. This article provides an overview of methodological and theoretical developments of PCA over the past decade, with focus on its applications to big data analytics. We first review the mathematical formulation of PCA and its theoretical development from the view point of perturbation analysis. We then briefly discuss the relationship between PCA and factor analysis as well as its applications to

We propose a high-dimensional classification method that involves nonparametric feature augmentation. Knowing that marginal density ratios are the most powerful univariate classifiers, we use the ratio estimates to transform the original feature measurements. Subsequently, penalized logistic regression is invoked, taking as input the newly transformed or augmented features. This procedure trains models equipped with local complexity and global simplicity, thereby avoiding the curse of dimensionality while creating a flexible nonlinear decision boundary. The resulting method is called feature augmentation via nonparametrics and selection (FANS). We motivate FANS by generalizing the naive Bayes model, writing the log ratio of joint densities as a linear combination of those of marginal densities. It is related to generalized additive models, but has better interpretability and computability. Risk bounds are

Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries by such data mining approaches be spurious due to high dimensionality and limited sample size? Can our fundamental assumptions on exogeneity of covariates needed for such variable selection be validated with the data? To answer these questions, we need to derive the distributions of the maximum spurious correlations given certain number of predictors, namely, the distribution of the correlation of a response variable Y with the best s linear combinations of p covariates X, even when X and Y are independent. When the covariance matrix of X possesses the restricted eigenvalue property, we derive such distributions for both finite s and diverging s, using Gaussian approximation and empirical process

In statistics and machine learning, we are interested in the eigenvectors (or singular vectors) of certain matrices (eg covariance matrices, data matrices, etc). However, those matrices are usually perturbed by noises or statistical errors, either from random sampling or structural patterns. The Davis-Kahan sin theorem is often used to bound the difference between the eigenvectors of a matrix A and those of a perturbed matrix A= A+ E, in terms of l2 norm. In this paper, we prove that when A is a low-rank and incoherent matrix, the l norm perturbation bound of singular vectors (or eigenvectors in the symmetric case) is smaller by a factor of