Large dimensional Gram type matrices are common objects in high-dimensional statistics and machine learning. In this paper, we study the limiting distribution of the edge eigenvalues for a general class of high-dimensional Gram type random matrices, including separable sample covariance matrices, sparse sample covariance matrices, bipartite stochastic block model and random Gram matrices with general variance profiles. Specifically, we prove that under (almost) sharp moment conditions and certain tractable regularity assumptions, the edge eigenvalues, i.e., the largest few eigenvalues of non-spiked Gram type random matrices or the extremal bulk eigenvalues of spiked Gram type random matrices, satisfy the Tracy-Widom distribution asymptotically. Our results can be used to construct adaptive, accurate and powerful statistics for high-dimensional statistical inference. In particular, we propose data-dependent statistics to infer the number of signals under general noise structure, test the one-sided sphericity of separable matrix, and test the structure of bipartite stochastic block model. Numerical simulations show strong support of our proposed statistics. The core of our proof is to establish the edge universality and Tracy-Widom distribution for a rectangular Dyson Brownian motion with regular initial data. This is a general strategy to study the edge statistics for high-dimensional Gram type random matrices without exploring the specific independence structure of the target matrices. It has potential to be applied to more general random matrices that are beyond the ones considered in this paper.

The purpose of this paper is to propose methodologies for statistical inference of low dimensional parameters with high dimensional data.We focus on constructing confidence intervals for individual coefficients and linear combinations of several of them in a linear regression model, although our ideas are applicable in a much broader context.The theoretical results that are presented provide sufficient conditions for the asymptotic normality of the proposed estimators along with a consistent estimator for their finite dimensional covariance matrices. These sufficient conditions allow the number of variables to exceed the sample size and the presence of many small non-zero coefficients. Our methods and theory apply to interval estimation of a preconceived regression coefficient or contrast as well as simultaneous interval estimation of many regression coefficients. Moreover, the method proposed turns the regression data into an approximate Gaussian sequence of point estimators of individual regression coefficients, which can be used to select variables after proper thresholding. The simulation results that are presented demonstrate the accuracy of the coverage probability of the confidence intervals proposed as well as other desirable properties, strongly supporting the theoretical results.

We propose a deep learning-based method for object detection in UAV-borne thermal images that have the capability of observing scenes in both day and night. Compared with visible images, thermal images have lower requirements for illumination conditions, but they typically have blurred edges and low contrast. Using a boundary-aware salient object detection network, we extract the saliency maps of the thermal images to improve the distinguishability. Thermal images are augmented with the corresponding saliency maps through channel replacement and pixel-level weighted fusion methods. Considering the limited computing power of UAV platforms, a lightweight combinational neural network ComNet is used as the core object detection method. The YOLOv3 model trained on the original images is used as a benchmark and compared with the proposed method. In the experiments, we analyze the detection performances of the ComNet models with different image fusion schemes. The experimental results show that the average precisions (APs) for pedestrian and vehicle detection have been improved by 2%~5% compared with the benchmark without saliency map fusion and MobileNetv2. The detection speed is increased by over 50%, while the model size is reduced by 58%. The results demonstrate that the proposed method provides a compromise model, which has application potential in UAV-borne detection tasks.

No abstract uploaded!

In this paper, we prove a CLT for the sample canonical correlation coefficients between two high-dimensional random vectors with finite rank correlations. More precisely, consider two random vectors $\wt{\bx}=\mathbf x + A \mathbf z $ and $\wt{\by}=\mathbf y + B \mathbf z $, where $\mathbf x \in \R^p$, $\mathbf y \in \R^q$ and $\mathbf z\in \R^r$ are independent random vectors with i.i.d.\;entries of mean zero and variance one, and $A \in \R^{p\times r}$ and $B\in \R^{q\times r}$ are two arbitrary deterministic matrices. Given $n$ samples of $\wt{\bx}$ and $\wt{\by}$, we stack them into two matrices $\cal X= X+AZ$ and $\cal Y= Y+BZ$, where $X\in \R^{p\times n}$, $Y\in \R^{q\times n}$ and $Z\in \R^{r\times n}$ are random matrices with i.i.d.\;entries of mean zero and variance one. Let $\wt\lambda_1 \ge \wt\lambda_2\ge \cdots \ge \wt\lambda_{r}$ be the largest $r$ eigenvalues of the sample canonical correlation (SCC) matrix $\cal C_{\cal X\cal Y}=(\cal X\cal X^\top)^{-1/2}\cal X\cal Y^\top (\cal Y\cal Y^\top)^{-1}\cal Y \cal X^\top (\cal X\cal X^\top)^{-1/2}$, and let $t_1\ge t_2 \ge \cdots\ge t_r$ be the squares of the population canonical correlation coefficients between $\wt{\bx}$ and $\wt{\by}$. Under certain moment assumptions, we show that there exists a threshold $t_c \in(0, 1)$ such that if $t_i>t_c$, then \smash{$\sqrt{n} (\wt\lambda_i-\theta_i)$} converges weakly to a centered normal distribution, where $\theta_i $ is a fixed outlier location determined by $t_i$. Our proof uses a self-adjoint linearization of the SCC matrix and a sharp local law on the inverse of the linearized matrix.

We derive the asymptotic distributions of the spiked eigenvalues and eigenvectors under a generalized and unified asymptotic regime, which takes into account the magnitude of spiked eigenvalues, sample size, and dimensionality. This regime allows high dimensionality and diverging eigenvalues and provides new insights into the roles that the leading eigenvalues, sample size, and dimensionality play in principal component analysis. Our results are a natural extension of those in Paul (2007) to a more general setting and solve the rates of convergence problems in Shen et al.(2013). They also reveal the biases of estimating leading eigenvalues and eigenvectors by using principal component analysis, and lead to a new covariance estimator for the approximate factor model, called shrinkage principal orthogonal complement thresholding (S-POET), that corrects the biases. Our results are successfully applied to

We have collected and cleaned two network data sets: Coauthorship and Citation networks for statisticians. The data sets are based on all research papers published in four of the top journals in statistics from 2003 to the first half of 2003 . We analyze the data sets from many different perspectives, focusing on (a) productivity, patterns and trends,(b) centrality and (c) community structures.

Consider two random vectors $\wt{\bx} \in \R^p$ and $\wt{\by} \in \mathbb R^q$ of the forms $\wt{\bx}=A \mathbf z + \bC_1^{1/2}\mathbf x $ and $\wt{\by}=B \mathbf z + \bC_2^{1/2}\mathbf y $, where $\mathbf x \in \R^p$, $\mathbf y \in \R^q$ and $\mathbf z\in \R^r$ are independent random vectors with i.i.d. entries of zero mean and unit variance, $\bC_1$ and $\bC_2$ are $p \times p$ and $q\times q$ deterministic population covariance matrices, and $A$ and $B$ are $p \times r$ and $q\times r$ deterministic factor loading matrices. With $n$ independent observations of $(\wt{\mathbf x},\wt{\mathbf y})$, we study the sample canonical correlations between $\wt{\bx} $ and $\wt{\by}$. We consider the high-dimensional setting with finite rank correlations, that is, ${p}/{n}\to c_1$ and ${q}/{n}\to c_2$ as $n\to \infty$ for some constants $c_1\in (0,1)$ and $c_2\in (0,1-c_1)$, and $r$ is a fixed integer. Let $t_1\ge t_2 \ge \cdots\ge t_r\ge 0$ be the squares of the nontrivial population canonical correlation coefficients between $\wt {\bx}$ and $\wt{\by}$, and let $\wt\lambda_1 \ge \wt\lambda_2\ge \cdots \ge \wt\lambda_{p\wedge q}\ge 0$ be the squares of the sample canonical correlation coefficients. If the entries of $\mathbf x$, $\mathbf y$ and $\mathbf z$ are i.i.d. Gaussian, then the following dichotomy has been shown in \cite{CCA} for a fixed threshold $t_c \in(0, 1)$: for any $1\le i \le r$, if $t_i < t_c$, then $\wt\lambda_i$ converges to the right-edge $\lambda_+$ of the limiting eigenvalue spectrum of the sample canonical correlation matrix, and moreover, $n^{2/3}(\wt\lambda_i-\lambda_+)$ converges weakly to the Tracy-Widom law; if $t_i>t_c$, then $\wt\lambda_i$ converges to a deterministic limit $\theta_i \in (\lambda_+, 1)$ that is determined by $c_1$, $c_2$ and $t_i$. In this paper, we prove that these results hold universally under the sharp fourth moment conditions on the entries of $\mathbf x$, $\mathbf y$ and $\mathbf z$. Moreover, we prove the results in full generality, in the sense that they also hold for near-degenerate $t_i$'s and for $t_i$'s that are close to the threshold $t_c$. Finally, we also provide almost sharp convergence rates for the sample canonical correlation coefficients under a general $a$-th moment assumption.

In this paper we introduce a smooth version of local linear regression estimators and address their advantages. The MSE and MISE of the estimators are computed explicitly. It turns out that the local linear regression smoothers have nice sampling properties and high minimax efficiency-they are not only efficient in rates but also nearly efficient in constant factors. In the nonparametric regression context, the asymptotic minimax lower bound is developed via the heuristic of the" hardest onedimensional subproblem" of Donoho and Liu. Connections of the minimax risk with the modulus of continuity are made. The lower bound is also applicable for estimating conditional mean (regression) and conditional quantiles for both fixed and random design regression problems.

No abstract uploaded!