This paper discusses statistical methods for estimating complex correlation structure from large pharmacogenomic datasets. We selectively review several prominent statistical methods for estimating large covariance matrix for understanding correlation structure, inverse covariance matrix for network modeling, large-scale simultaneous tests for selecting significantly differently expressed genes and proteins and genetic markers for complex diseases, and high dimensional variable selection for identifying important molecules for understanding molecule mechanisms in pharmacogenomics. Their applications to gene network estimation and biomarker selection are used to illustrate the methodological power. Several new challenges of Big data analysis, including complex data distribution, missing data, measurement error, spurious correlation, endogeneity, and the need for robust statistical methods, are also discussed.

Several new tests are proposed for examining the adequacy of a family of parametric models against large nonparametric alternatives. These tests formally check if the bias vector of residuals from parametric fits is negligible by using the adaptive Neyman test and other methods. The testing procedures formalize the traditional model diagnostic tools based on residual plots. We examine the rates of contiguous alternatives that can be detected consistently by the adaptive Neyman test. Applications of the procedures to the partially linear models are thoroughly discussed. Our simulation studies show that the new testing procedures are indeed powerful and omnibus. The power of the proposed tests is comparable to the <i>F</i>-test statistic even in the situations where the <i>F</i> test is known to be suitable and can be far more powerful than the <i>F</i>-test statistic in other situations. An application to testing linear models versus

Local quasi-likelihood estimation is useful for nonparametric modeling in a widely-used exponential family of distributions, called generalized linear models. Yet, the technique cannot be directly applied to situations where a response variable is missing at random. Three local quasi-likelihood estimation techniques are introduced: the local quasi-likelihood estimator using only complete-data; the locally weighted quasi-likelihood method; the local quasi-likelihood estimator with imputed values. These estimators share basically the same first order asymptotic biases and variances. Our simulation results show that substantial efficiency gains can be obtained by using the local quasi-likelihood estimator with imputed values. We develop the local quasi-likelihood imputation methods for estimating the mean functional of the response variable. It is shown that the proposed mean imputation estimators are asymptotically normal with asymptotic variance that can be easily estimated. Data from an ongoing environmental epidemiologic study is used to illustrate the proposed methods.

The main purpose of this workshop was to assemble international leaders from statistics and machine learning to identify important research problems, to cross-fertilize between the disciplines, and to ultimately start coordinated research efforts toward better solutions. The workshop focused on discussing modern methods for analysis complex high dimensional data with applications to econometrics, finance, biomedicine, genomics etc.

We consider diffusivity of random walks with transition probabilities depending on the number of consecutive traversals of the last traversed edge, the so called senile reinforced random walk (SeRW). In one dimension, the walk is known to be sub-diffusive with identity reinforcement function. We perturb the model by introducing a small probability \delta of escaping the last traversed edge at each step. The perturbed SeRW model is diffusive for any \delta , with enhanced diffusivity (\delta ) in the small \delta regime. We further study stochastically perturbed SeRW models by having the last edge escape probability of the form \delta with \delta 's being independent random variables. Enhanced diffusivity in such models are logarithmically close to the so called residual diffusivity (positive in the zero \delta limit), with diffusivity between \delta and \delta . Finally, we generalize our results to higher dimensions where the unperturbed model is already diffusive. The enhanced diffusivity can be as much as \delta .