MathSciDoc: An Archive for Mathematician ∫

Most papers on high-dimensional statistics are based on the assumption that none of the regressors are correlated with the regression error, namely, they are exogeneous. Yet, endogeneity arises easily in high-dimensional regression due to a large pool of regressors and this causes the inconsistency of the penalized least-squares methods and possible false scientific discoveries. A necessary condition for model selection of a very general class of penalized regression methods is given, which allows us to prove formally the inconsistency claim. To cope with the possible endogeneity, we construct a novel penalized focussed generalized method of moments (FGMM) criterion function and offer a new optimization algorithm. The FGMM is not a smooth function. To establish its asymptotic properties, we first study the model selection consistency and an oracle property for a general class of penalized regression methods. These results are then used to show that the FGMM possesses an oracle property even in the presence of endogenous predictors, and that the solution is also near global minimum under the over-identification assumption. Finally, we also show how the semi-parametric efficiency of estimation can be achieved via a two-step approach.

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are collected at an ever-growing scale, statistical machine learning faces some new challenges: high dimensionality, strong dependence among observed variables, heavy-tailed variables and heterogeneity. High-dimensional robust factor analysis serves as a powerful toolkit to conquer these challenges.

Large-scale multiple testing with correlated and heavy-tailed data arises in a wide range of research areas from genomics, medical imaging to finance. Conventional methods for estimating the false discovery proportion (FDP) often ignore the effect of heavy-tailedness and the dependence structure among test statistics, and thus may lead to inefficient or even inconsistent estimation. Also, the assumption of joint normality is often imposed, which is too stringent for many applications. To address these challenges, in this paper we propose a factoradjusted robust procedure for large-scale simultaneous inference with control of the false discovery proportion. We demonstrate that robust factor adjustments are extremely important in both improving the power of the tests and controlling FDP. We identify general conditions under which the proposed method produces consistent estimate of the FDP. As a byproduct that is of independent interest, we establish an exponential-type deviation inequality for a robust U-type covariance estimator under the spectral norm. Extensive numerical experiments demonstrate the advantage of the proposed method over several state-of-the-art methods especially when the data are generated from heavy-tailed distributions. Our proposed procedures are implemented in the R-package FarmTest. Supported by NSF Grants DMS-1662139, DMS-1712591, and NIH Grant R01-GM072611-12.

In an event-related functional MRI data analysis, an accurate and robust extraction of the hemodynamic response function (HRF) and its associated statistics (e.g., magnitude, width, and time to peak) is critical to infer quantitative information about the relative timing of the neuronal events in different brain regions. The aim of this paper is to develop a multiscale adaptive smoothing model (MASM) to accurately estimate HRFs pertaining to each stimulus sequence across all voxels. MASM explicitly accounts for both spatial and temporal smoothness information, while incorporating such information to adaptively estimate HRFs in the frequency domain. One simulation study and a real data set are used to demonstrate the methodology and examine its finite sample performance in HRF estimation, which confirms that MASM significantly outperforms the existing methods including the smooth finite impulse

It has been reported that the plasma levels of VEGF in tumor patients decreased during dendritic cell (DC)-based immunotherapy, but the underlying mechanism remains unclear. Our current report demonstrates that VEGF levels were significantly decreased in the supernatants of DCs incubated with rhVEGF or tumor conditioned medium (TCM) while the intracellular VEGF in DCs was increased. The increased intracellular VEGF was not due to the <i>de novo</i> VEGF synthesis by DCs because exogenous VEGF inhibited the mRNA expression of VEGF in DCs. More direct evidence was provided to demonstrate that Cy3-labeled VEGF could be internalized by DCs specifically and efficiently. In addition, the activity of DCs to internalize VEGF was abolished by neutralizing antibody against VEGF receptor-1 (Flt-1) and inhibitors of endocytosis such as carbonyl cyanide m-chlorophenyl hydrazone (CCCP) and genistein. This

Estimation of genewise variance arises from two important applications in microarray data analysis: selecting significantly differentially expressed genes and validation tests for normalization of microarray data. We approach the problem by introducing a two-way nonparametric model, which is an extension of the famous Neyman-Scott model and is applicable beyond microarray data. The problem itself poses interesting challenges because the number of nuisance parameters is proportional to the sample size and it is not obvious how the variance function can be estimated when measurements are correlated. In such a high-dimensional nonparametric problem, we proposed two novel nonparametric estimators for genewise variance function and semiparametric estimators for measurement correlation, via solving a system of nonlinear equations. Their asymptotic normality is established. The finite sample property is

This book presents an overview of recent developments in biostatistics and bioinformatics. Written by active researchers in these emerging areas, it is intended to give graduate students and new researchers an idea of where the frontiers of biostatistics and bioinformatics are as well as a forum to learn common techniques in use, so that they can advance the fields via developing new techniques and new results. Extensive references are provided so that researchers can follow the threads to learn more comprehensively what the literature is and to conduct their own research. In particulars, the book covers three important and rapidly advancing topics in biostatistics: analysis of survival and longitudinal data, statistical methods for epidemiology, and bioinformatics.

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when the covariates are highly correlated. Motivated by econometric studies, we consider the case where covariate dependence can be reduced through factor model, and propose a consistent strategy named Factor-Adjusted Regularized Model Selection (FarmSelect). By separating the latent factors from idiosyncratic components, we transform the problem from model selection with highly correlated covariates to that with weakly correlated variables. Model selection consistency as well as optimal rates of convergence are obtained under mild conditions. Numerical studies demonstrate the nice finite sample performance in terms of both model selection and out-of-sample prediction. Moreover, our method is flexible in a sense that it pays no price for weakly correlated and uncorrelated cases. Our method is applicable to a wide range of high dimensional sparse regression problems. An R-package FarmSelect is also provided for implementation.

Error variance estimation plays an important role in statistical inference for high-dimensional regression models. This article concerns with error variance estimation in high-dimensional sparse additive model. We study the asymptotic behavior of the traditional mean squared errors, the naive estimate of error variance, and show that it may significantly underestimate the error variance due to spurious correlations that are even higher in nonparametric models than linear models. We further propose an accurate estimate for error variance in ultrahigh-dimensional sparse additive model by effectively integrating sure independence screening and refitted cross-validation techniques. The root <i>n</i> consistency and the asymptotic normality of the resulting estimate are established. We conduct Monte Carlo simulation study to examine the finite sample performance of the newly proposed estimate. A real data example is used to

Value-at-risk measures the worst loss to be expected of a portfolio over a given time horizon at a given confidence level. Calculation of VaR frequently involves estimating the volatility of return processes and quantiles of standardized returns. In this paper, several semiparametric techniques are introduced to estimate the volatilities. In addition, both parametric and nonparametric techniques are proposed to estimate the quantiles of standardized return processes. The newly proposed techniques also have the flexibility to adapt automatically to the changes in the dynamics of market prices over time. The combination of newly proposed techniques for estimating volatility and standardized quantiles yields several new techniques for evaluating multiple period VaR. The performance of the newly proposed VaR estimators is evaluated and compared with some of existing methods. Our simulation results and empirical