In this paper, we prove a necessary and sufficient condition for Tracy-Widom law of Wigner matrices. Consider $N \times N$ symmetric Wigner matrices $H$ with $H_{ij} = N^{-1/2} x_{ij}$, whose upper right entries $x_{ij}$ $(1\le i< j\le N)$ are $i.i.d.$ random variables with distribution $\mu$ and diagonal entries $x_{ii}$ $(1\le i\le N)$ are $i.i.d.$ random variables with distribution $\wt \mu$. The means of $\mu$ and $\wt \mu$ are zero, the variance of $\mu$ is 1, and the variance of $\wt \mu $ is finite. We prove that Tracy-Widom law holds if and only if $\lim_{s\to \infty}s^4\p(|x_{12}| \ge s)=0$. The same criterion holds for Hermitian Wigner matrices.

Large dimensional Gram type matrices are common objects in high-dimensional statistics and machine learning. In this paper, we study the limiting distribution of the edge eigenvalues for a general class of high-dimensional Gram type random matrices, including separable sample covariance matrices, sparse sample covariance matrices, bipartite stochastic block model and random Gram matrices with general variance profiles. Specifically, we prove that under (almost) sharp moment conditions and certain tractable regularity assumptions, the edge eigenvalues, i.e., the largest few eigenvalues of non-spiked Gram type random matrices or the extremal bulk eigenvalues of spiked Gram type random matrices, satisfy the Tracy-Widom distribution asymptotically. Our results can be used to construct adaptive, accurate and powerful statistics for high-dimensional statistical inference. In particular, we propose data-dependent statistics to infer the number of signals under general noise structure, test the one-sided sphericity of separable matrix, and test the structure of bipartite stochastic block model. Numerical simulations show strong support of our proposed statistics. The core of our proof is to establish the edge universality and Tracy-Widom distribution for a rectangular Dyson Brownian motion with regular initial data. This is a general strategy to study the edge statistics for high-dimensional Gram type random matrices without exploring the specific independence structure of the target matrices. It has potential to be applied to more general random matrices that are beyond the ones considered in this paper.

In this paper, we prove a necessary and sufficient condition for Tracy-Widom law of Wigner matrices. Consider N×N symmetric Wigner matrices H with Hij=N−1/2xij, whose upper right entries xij (1≤i<j≤N) are i.i.d. random variables with distribution μ and diagonal entries xii (1≤i≤N) are i.i.d. random variables with distribution $\wt \mu$. The means of μ and $\wt \mu$ are zero, the variance of μ is 1, and the variance of $\wt \mu$ is finite. We prove that Tracy-Widom law holds if and only if $\lim_{s\to \infty}s^4\p(|x_{12}| \ge s)=0$. The same criterion holds for Hermitian Wigner matrices.

We analyse the spectrum of additive finite-rank deformations of $N \times N$ Wigner matrices $H$. The spectrum of the deformed matrix undergoes a transition, associated with the creation or annihilation of an outlier, when an eigenvalue $d_i$ of the deformation crosses a critical value $\pm 1$. This transition happens on the scale $|d_i| - 1 \sim N^{-1/3}$. We allow the eigenvalues $d_i$ of the deformation to depend on $N$ under the condition $|\abs{d_i} - 1| \geq (\log N)^{C \log \log N} N^{-1/3}$. We make no assumptions on the eigenvectors of the deformation. In the limit $N \to \infty$, we identify the law of the outliers and prove that the non-outliers close to the spectral edge have a universal distribution coinciding with that of the extremal eigenvalues of a Gaussian matrix ensemble. A key ingredient in our proof is the \emph{isotropic local semicircle law}, which establishes optimal high-probability bounds on the quantity $< v,[(H - z)^{-1} - m(z) 1] w >$, where $m(z)$ is the Stieltjes transform of Wigner's semicircle law and $v, w$ are arbitrary deterministic vectors.

We consider ASEP on a bounded interval and on a half‐line with sources and sinks. On the full line, Bertini and Giacomin in 1997 proved convergence under weakly asymmetric scaling of the height function to the solution of the KPZ equation. We prove here that under similar weakly asymmetric scaling of the sources and sinks as well, the bounded interval ASEP height function converges to the KPZ equation on the unit interval with Neumann boundary conditions on both sides (different parameter for each side), and likewise for the half‐line ASEP to KPZ on a half‐line. This result can be interpreted as showing that the KPZ equation arises at the triple critical point (maximal current / high density / low density) of the open ASEP.

We consider the ensemble of adjacency matrices of Erdős–Rényi random graphs, that is, graphs on $N$ vertices where every edge is chosen independently and with probability $p\equiv p(N)$. We rescale the matrix so that its bulk eigenvalues are of order one. We prove that, as long as $pN\to\infty$ (with a speed at least logarithmic in $N$), the density of eigenvalues of the Erdős–Rényi ensemble is given by the Wigner semicircle law for spectral windows of length larger than $N^{-1}$ (up to logarithmic corrections). As a consequence, all eigenvectors are proved to be completely delocalized in the sense that the $\ell^{\infty}$-norms of the $\ell^{2}$-normalized eigenvectors are at most of order $N^{-1/2}$ with a very high probability. The estimates in this paper will be used in the companion paper [Spectral statistics of Erdős–Rényi graphs II: Eigenvalue spacing and the extreme eigenvalues (2011) Preprint] to prove the universality of eigenvalue distributions both in the bulk and at the spectral edges under the further restriction that $pN\gg N^{2/3}$.

We consider a general class of symmetric or Hermitian random band matrices $H=(h_{xy})_{x,y \in \llbracket 1,N\rrbracket^d}$ in any dimension $d\ge 1$, where the entries are independent, centered random variables with variances $s_{xy}=\mathbb E|h_{xy}|^2$. We assume that $s_{xy}$ vanishes if $|x-y|$ exceeds the band width $W$, and we are interested in the mesoscopic scale with $1\ll W\ll N$. Define the {\it{generalized resolvent}} of $H$ as $G(H,Z):=(H - Z)^{-1}$, where $Z$ is a deterministic diagonal matrix with entries $Z_{xx}\in \mathbb C_+$ for all $x$. Then we establish a precise high-probability bound on certain averages of polynomials of the resolvent entries. As an application of this fluctuation averaging result, we give a self-contained proof for the delocalization of random band matrices in dimensions $d\ge 2$. More precisely, for any fixed $d\ge 2$, we prove that the bulk eigenvectors of $H$ are delocalized in certain averaged sense if $N\le W^{1+\frac{d}{2}}$. This improves the corresponding results in \cite{HeMa2018} under the assumption $N\ll W^{1+\frac{d}{d+1}}$, and in \cite{ErdKno2013,ErdKno2011} under the assumption $N\ll W^{1+\frac{d}{6}}$. For 1D random band matrices, our fluctuation averaging result was used in \cite{PartII,PartI} to prove the delocalization conjecture and bulk universality for random band matrices with $N\ll W^{4/3}$.

In this paper, we consider the universality of the local eigenvalue statistics of random matrices. Our main result shows that these statistics are determined by the first four moments of the distribution of the entries. As a consequence, we derive the universality of eigenvalue gap distribution and$k$-point correlation, and many other statistics (under some mild assumptions) for both Wigner Hermitian matrices and Wigner real symmetric matrices.

We prove an estimate on the smallest singular value of a multiplicatively and additively deformed random rectangular matrix. Suppose $n\le N \le M \le dN$ for some constant $d\ge 1$. Let $X$ be an $M\times n$ random matrix with independent and identically distributed entries, which have zero mean, unit variance and arbitrarily high moments. Let $T$ be an $N\times M$ deterministic matrix with comparable singular values $c\le s_{N}(T) \le s_{1}(T) \le c^{-1}$ for some constant $c>0$. Let $A$ be an $N\times n$ deterministic matrix with $\|A\|=O(\sqrt{N})$. Then we prove that for any $\epsilon>0$, the smallest singular value of $TX-A$ is larger than $N^{-\epsilon}(\sqrt{N}-\sqrt{n-1})$ with high probability. If we assume further the entries of $X$ have subgaussian decay, then the smallest singular value of $TX-A$ is at least of the order $\sqrt{N}-\sqrt{n-1}$ with high probability, which is an essentially optimal estimate.

We introduce a class of M×M sample covariance matrices Q which subsumes and generalizes several previous models. The associated population covariance matrix Σ=EQ is assumed to differ from the identity by a matrix of bounded rank. All quantities except the rank of Σ−IM may depend on M in an arbitrary fashion. We investigate the principal components, i.e.\ the top eigenvalues and eigenvectors, of Q. We derive precise large deviation estimates on the generalized components ⟨w,ξi⟩ of the outlier and non-outlier eigenvectors ξi. Our results also hold near the so-called BBP transition, where outliers are created or annihilated, and for degenerate or near-degenerate outliers. We believe the obtained rates of convergence to be optimal. In addition, we derive the asymptotic distribution of the generalized components of the non-outlier eigenvectors. A novel observation arising from our results is that, unlike the eigenvalues, the eigenvectors of the principal components contain information about the \emph{subcritical} spikes of Σ. The proofs use several results on the eigenvalues and eigenvectors of the uncorrelated matrix Q, satisfying EQ=IM, as input: the isotropic local Marchenko-Pastur law established in [9], level repulsion, and quantum unique ergodicity of the eigenvectors. The latter is a special case of a new universality result for the joint eigenvalue-eigenvector distribution.

In this paper we prove the universality of covariance matrices of the form $H_{Ntimes N}={X}^{dagger}X$ where $X$ is an ${Mtimes N}$ rectangular matrix with independent real valued entries $x_{ij}$ satisfying $mathbb{E}x_{ij}=0$ and $mathbb{E}x^2_{ij}={frac{1}{M}}$, $N$, $Mto infty$. Furthermore it is assumed that these entries have sub-exponential tails or sufficiently high number of moments. We will study the asymptotics in the regime $N/M=d_Nin(0,infty),lim_{Ntoinfty}d_Nneq0,infty$. Our main result is the edge universality of the sample covariance matrix at both edges of the spectrum. In the case $lim_{Ntoinfty}d_N=1$, we only focus on the largest eigenvalue. Our proof is based on a novel version of the Green function comparison theorem for data matrices with dependent entries. En route to proving edge universality, we establish that the Stieltjes transform of the empirical eigenvalue distribution of $H$ is given by the Marcenko-Pastur law uniformly up to the edges of the spectrum with an error of order $(Neta)^{-1}$ where $eta$ is the imaginary part of the spectral parameter in the Stieltjes transform. Combining these results with existing techniques we also show bulk universality of covariance matrices. All our results hold for both real and complex valued entries.

In this paper, we prove a necessary and sufficient condition for the edge universality of sample covariance matrices with general population. We consider sample covariance matrices of the form $\mathcal Q = TX(TX)^{*}$, where $X$ is an $M_2\times N$ random matrix with $X_{ij}=N^{-1/2}q_{ij}$ such that $q_{ij}$ are $i.i.d.$ random variables with zero mean and unit variance, and $T$ is an $M_1 \times M_2$ deterministic matrix such that $T^* T$ is diagonal. We study the asymptotic behavior of the largest eigenvalues of $\mathcal Q$ when $M:=\min\{M_1,M_2\}$ and $N$ tend to infinity with $\lim_{N \to \infty} {N}/{M}=d \in (0, \infty)$. We prove that the Tracy-Widom law holds for the largest eigenvalue of $\mathcal Q$ if and only if $\lim_{s \rightarrow \infty}s^4 \mathbb{P}(\vert q_{ij} \vert \geq s)=0$ under mild assumptions of $T$. The necessity and sufficiency of this condition for the edge universality was first proved for Wigner matrices by Lee and Yin [34].

We give a solution to the inverse problem (given a prescribed function, find a corresponding group) for large classes of speed, entropy, isoperimetric profile, return probability and Lp-compression functions of finitely generated groups. For smaller classes, we give solutions among solvable groups of exponential volume growth. As corollaries, we prove a recent conjecture of Amir on joint evaluation of speed and entropy exponents and we obtain a new proof of the existence of uncountably many pairwise non-quasi-isometric solvable groups, originally due to Cornulier and Tessera. We also obtain a formula relating the Lp-compression exponent of a group and its wreath product with the cyclic group forp in [1,2].

The {\it{eigenvector empirical spectral distribution}} (VESD) is a useful tool in studying the limiting behavior of eigenvalues and eigenvectors of covariance matrices. In this paper, we study the convergence rate of the VESD of sample covariance matrices to the deformed Mar{\v c}enko-Pastur (MP) distribution. Consider sample covariance matrices of the form $\Sigma^{1/2} X X^* \Sigma^{1/2}$, where $X=(x_{ij})$ is an $M\times N$ random matrix whose entries are independent random variables with mean zero and variance $N^{-1}$, and $\Sigma$ is a deterministic positive-definite matrix. We prove that the Kolmogorov distance between the {\it{expected VESD}} and the deformed MP distribution is bounded by $N^{-1+\epsilon}$ for any fixed $\epsilon>0$, provided that the entries $\sqrt{N}x_{ij}$ have uniformly bounded 6th moments and $|N/M-1|\ge \tau$ for some constant $\tau>0$. This result improves the previous one obtained in [44], which gave the convergence rate $O(N^{-1/2})$ assuming $i.i.d.$ $X$ entries, bounded 10th moment, $\Sigma=I$ and $M<N$. Moreover, we also prove that under the finite $8$th moment assumption, the convergence rate of the VESD is $O(N^{-1/2+\epsilon})$ almost surely for any fixed $\epsilon>0$, which improves the previous bound $N^{-1/4+\epsilon}$ in [44].

We derive the joint asymptotic distribution of the outlier eigenvalues of an additively deformed Wigner matrix $H$. Our only assumptions on the deformation are that its rank be fixed and its norm bounded. Our results extend those of [The isotropic semicircle law and deformation of Wigner matrices. Preprint] by admitting overlapping outliers and by computing the joint distribution of all outliers. In particular, we give a complete description of the failure of universality first observed in [Ann. Probab. 37 (2009) 1-47; Ann. Inst. Henri Poincar\'{e} Probab. Stat. 48 (1013) 107-133; Free convolution with a semi-circular distribution and eigenvalues of spiked deformations of Wigner matrices. Preprint]. We also show that, under suitable conditions, outliers may be strongly correlated even if they are far from each other. Our proof relies on the isotropic local semicircle law established in [The isotropic semicircle law and deformation of Wigner matrices. Preprint]. The main technical achievement of the current paper is the joint asymptotics of an arbitrary finite family of random variables of the form $\langle\mathbf{v},(H-z)^{-1}\mathbf{w}\rangle$.

We prove the universality for the eigenvalue gap statistics in the bulk of the spectrum for band matrices, in the regime where the band width is comparable with the dimension of the matrix, $W \sim N$. All previous results concerning universality of non-Gaussian random matrices are for mean-field models. By relying on a new mean-field reduction technique, we deduce universality from quantum unique ergodicity for band matrices.

It is well known that the spectral measure of eigenvalues of a rescaled square non-Hermitian random matrix with independent entries satises the circular law. We consider the product $T X$, where $T$ is a deterministic $N\times M$ matrix and $X$ is a random $M\times  N$ matrix with independent entries having zero mean and variance $(N \wedge M) ^{-1}$. We prove a general local circular law for the empirical spectral distribution (ESD) of $TX$ at any point $z$ away from the unit circle under the assumptions that$ N \sim M$, and the matrix entries $X_{ij} have suciently high moments. More precisely, if $z$ satisfes $| |z|
- 1| \ge \tau$  for arbitrarily small $\tau > 0, the ESD of $TX$ converges to $\tilde{X}_D (z) d A(z)$, where $\tilde{X}_D$ is a rotation-invariant function determined by the singular valuau of $T$ and $dA$ denotes the Lebesgue measure on $\mathbb{C}$. The local circular law is valid around $z$ up to scale $(N \wedge M) ^{-1/4+\epsilon}$ for any  $\epsilon >0$. Moreover, if $|z| >1$ or the matrix entries of $X$ have vanishing third moments, the local circular law is valid around $z$ up to scale $(N \wedge M) ^{-1/2+\epsilon}$ for any  $\epsilon >0$.

In this paper, we prove a CLT for the sample canonical correlation coefficients between two high-dimensional random vectors with finite rank correlations. More precisely, consider two random vectors $\wt{\bx}=\mathbf x + A \mathbf z $ and $\wt{\by}=\mathbf y + B \mathbf z $, where $\mathbf x \in \R^p$, $\mathbf y \in \R^q$ and $\mathbf z\in \R^r$ are independent random vectors with i.i.d.\;entries of mean zero and variance one, and $A \in \R^{p\times r}$ and $B\in \R^{q\times r}$ are two arbitrary deterministic matrices. Given $n$ samples of $\wt{\bx}$ and $\wt{\by}$, we stack them into two matrices $\cal X= X+AZ$ and $\cal Y= Y+BZ$, where $X\in \R^{p\times n}$, $Y\in \R^{q\times n}$ and $Z\in \R^{r\times n}$ are random matrices with i.i.d.\;entries of mean zero and variance one. Let $\wt\lambda_1 \ge \wt\lambda_2\ge \cdots \ge \wt\lambda_{r}$ be the largest $r$ eigenvalues of the sample canonical correlation (SCC) matrix $\cal C_{\cal X\cal Y}=(\cal X\cal X^\top)^{-1/2}\cal X\cal Y^\top (\cal Y\cal Y^\top)^{-1}\cal Y \cal X^\top (\cal X\cal X^\top)^{-1/2}$, and let $t_1\ge t_2 \ge \cdots\ge t_r$ be the squares of the population canonical correlation coefficients between $\wt{\bx}$ and $\wt{\by}$. Under certain moment assumptions, we show that there exists a threshold $t_c \in(0, 1)$ such that if $t_i>t_c$, then \smash{$\sqrt{n} (\wt\lambda_i-\theta_i)$} converges weakly to a centered normal distribution, where $\theta_i $ is a fixed outlier location determined by $t_i$. Our proof uses a self-adjoint linearization of the SCC matrix and a sharp local law on the inverse of the linearized matrix.

We propose a deep learning-based method for object detection in UAV-borne thermal images that have the capability of observing scenes in both day and night. Compared with visible images, thermal images have lower requirements for illumination conditions, but they typically have blurred edges and low contrast. Using a boundary-aware salient object detection network, we extract the saliency maps of the thermal images to improve the distinguishability. Thermal images are augmented with the corresponding saliency maps through channel replacement and pixel-level weighted fusion methods. Considering the limited computing power of UAV platforms, a lightweight combinational neural network ComNet is used as the core object detection method. The YOLOv3 model trained on the original images is used as a benchmark and compared with the proposed method. In the experiments, we analyze the detection performances of the ComNet models with different image fusion schemes. The experimental results show that the average precisions (APs) for pedestrian and vehicle detection have been improved by 2%~5% compared with the benchmark without saliency map fusion and MobileNetv2. The detection speed is increased by over 50%, while the model size is reduced by 58%. The results demonstrate that the proposed method provides a compromise model, which has application potential in UAV-borne detection tasks.

We consider Hermitian random band matrices $H=(h_{xy})$ on the $d$-dimensional lattice $(\Z/L\Z)^d$. The entries $h_{xy}$ are independent (up to Hermitian conditions) centered complex Gaussian random variables with variances $s_{xy}=\mathbb E|h_{xy}|^2$. The variance matrix $S=(s_{xy})$ has a banded structure so that $s_{xy}$ is negligible if $|x-y|$ exceeds the band width $W$. In dimensions $d\ge 8$, we prove that, as long as $W\ge L^\e$ for a small constant $\e>0$, with high probability most bulk eigenvectors of $H$ are delocalized in the sense that their localization lengths are comparable to $L$. Denote by $G(z)=(H-z)^{-1}$ the Green's function of $H$. For $\im z\gg W^2/L^2$, we also prove a widely used criterion in physics for quantum diffusion of this model, namely, the leading term in the Fourier transform of $\E|G_{xy}(z)|^2$ with respect to $x-y$ is of the form $(\im z + a(p))^{-1}$ for some $a(p)$ quadratic in $p$, where $p$ is the Fourier variable. Our method is based on an expansion of $T_{xy}=|m|^2 \sum_{\alpha}s_{x\alpha}|G_{\alpha y}|^2$ and it requires a self-energy renormalization up to error $W^{-K}$ for any large constant $K$ independent of $W$ and $L$. We expect that this method can be extended to non-Gaussian band matrices.

We investigate the energy landscape of the mixed even p-spin model with Ising spin configurations. We show that for any given energy level between zero and the maximal energy, with overwhelming probability there exist exponentially many distinct spin configurations such that their energies stay near this energy level. Furthermore, their magnetizations and overlaps are concentrated around some fixed constants. In particular, at the level of maximal energy, we prove that the Hamiltonian exhibits exponentially many orthogonal peaks. This improves the results of Chatterjee [20] and Ding-Eldan-Zhai [29], where the former established a logarithmic size of the number of the orthogonal peaks, while the latter proved a polynomial size. Our second main result obtains disorder chaos at zero temperature and at any external field. As a byproduct, this implies that the fluctuation of the maximal energy is superconcentrated when the external field vanishes and obeys a Gaussian limit law when the external field is present.

We compute the almost-sure Hausdorff dimension of the double points of chordal SLE$_\kappa$ for $\kappa > 4$, confirming a prediction of Duplantier--Saleur (1989) for the contours of the FK model. We also compute the dimension of the cut points of chordal SLE$_\kappa$ for $\kappa > 4$ as well as analogous dimensions for the radial and whole-plane SLE$_\kappa(\rho)$ processes for $\kappa > 0$. We derive these facts as consequences of a more general result in which we compute the dimension of the intersection of two flow lines of the formal vector field $e^{ih/\chi}$, where $h$ is a Gaussian free field and $\chi > 0$, of different angles with each other and with the domain boundary.

We develop a new method for deriving local laws for a large class of random matrices. It is applicable to many matrix models built from sums and products of deterministic or independent random matrices. In particular, it may be used to obtain local laws for matrix ensembles that are \emph{anisotropic} in the sense that their resolvents are well approximated by deterministic matrices that are not multiples of the identity. For definiteness, we present the method for sample covariance matrices of the form Q:=TXX∗T∗, where T is deterministic and X is random with independent entries. We prove that with high probability the resolvent of Q is close to a deterministic matrix, with an optimal error bound and down to optimal spectral scales. As an application, we prove the edge universality of Q by establishing the Tracy-Widom-Airy statistics of the eigenvalues of Q near the soft edges. This result applies in the single-cut and multi-cut cases. Further applications include the distribution of the eigenvectors and an analysis of the outliers and BBP-type phase transitions in finite-rank deformations; they will appear elsewhere. We also apply our method to Wigner matrices whose entries have arbitrary expectation, i.e. we consider W+A where W is a Wigner matrix and a Hermitian deterministic matrix. We prove the anisotropic local law for W+A and use it to establish edge universality.

No abstract uploaded!

Consider two random vectors $\wt{\bx} \in \R^p$ and $\wt{\by} \in \mathbb R^q$ of the forms $\wt{\bx}=A \mathbf z + \bC_1^{1/2}\mathbf x $ and $\wt{\by}=B \mathbf z + \bC_2^{1/2}\mathbf y $, where $\mathbf x \in \R^p$, $\mathbf y \in \R^q$ and $\mathbf z\in \R^r$ are independent random vectors with i.i.d. entries of zero mean and unit variance, $\bC_1$ and $\bC_2$ are $p \times p$ and $q\times q$ deterministic population covariance matrices, and $A$ and $B$ are $p \times r$ and $q\times r$ deterministic factor loading matrices. With $n$ independent observations of $(\wt{\mathbf x},\wt{\mathbf y})$, we study the sample canonical correlations between $\wt{\bx} $ and $\wt{\by}$. We consider the high-dimensional setting with finite rank correlations, that is, ${p}/{n}\to c_1$ and ${q}/{n}\to c_2$ as $n\to \infty$ for some constants $c_1\in (0,1)$ and $c_2\in (0,1-c_1)$, and $r$ is a fixed integer. Let $t_1\ge t_2 \ge \cdots\ge t_r\ge 0$ be the squares of the nontrivial population canonical correlation coefficients between $\wt {\bx}$ and $\wt{\by}$, and let $\wt\lambda_1 \ge \wt\lambda_2\ge \cdots \ge \wt\lambda_{p\wedge q}\ge 0$ be the squares of the sample canonical correlation coefficients. If the entries of $\mathbf x$, $\mathbf y$ and $\mathbf z$ are i.i.d. Gaussian, then the following dichotomy has been shown in \cite{CCA} for a fixed threshold $t_c \in(0, 1)$: for any $1\le i \le r$, if $t_i < t_c$, then $\wt\lambda_i$ converges to the right-edge $\lambda_+$ of the limiting eigenvalue spectrum of the sample canonical correlation matrix, and moreover, $n^{2/3}(\wt\lambda_i-\lambda_+)$ converges weakly to the Tracy-Widom law; if $t_i>t_c$, then $\wt\lambda_i$ converges to a deterministic limit $\theta_i \in (\lambda_+, 1)$ that is determined by $c_1$, $c_2$ and $t_i$. In this paper, we prove that these results hold universally under the sharp fourth moment conditions on the entries of $\mathbf x$, $\mathbf y$ and $\mathbf z$. Moreover, we prove the results in full generality, in the sense that they also hold for near-degenerate $t_i$'s and for $t_i$'s that are close to the threshold $t_c$. Finally, we also provide almost sharp convergence rates for the sample canonical correlation coefficients under a general $a$-th moment assumption.