A weighted and convex regularized nuclear norm model is introduced to construct a rank constrained linear transform on feature vectors of deep neural networks. The feature vectors of each class are modeled by a subspace, and the linear transform aims to enlarge the pairwise angles of the subspaces. The weight and convex regularization resolve the rank degeneracy of the linear transform. The model is computed by a dierence of convex function algorithm whose descent and convergence properties are analyzed. Numerical experiments are carried out in convolutional neural networks on CAFFE platform for 10 class handwritten digit images (MNIST) and small object color images (CIFAR-10) in the public domain. The transformed feature vectors improve the accuracy of the network in the regime of low dimensional features subsequent to principal component analysis. The feature transform is independent of the network structure, and can be applied without retraining the feature extraction layers of the network.

We propose to study the Hessian metric of given functional in the space of probability space embedded with L^2–Wasserstein (optimal transport) metric. We name it transport Hessian metric, which contains and extends the classical L^2–Wasserstein metric. We formulate several dynamical systems associated with transport Hessian metrics. Several connections between transport Hessian metrics and math physics equations are discovered. E.g., the transport Hessian gradient flow, including Newton’s flow, formulates a mean-field kernel Stein variational gradient flow; The transport Hessian Hamiltonian flow of negative Boltzmann-Shannon entropy forms the Shallow water’s equation; The transport Hessian gradient flow of Fisher information forms the heat equation. Several examples and closed-form solutions of finite-dimensional transport Hessian metrics and dynamics are presented.

Inspired by the graph Laplacian and the point integral method, we introduce a novel weighted graph Laplacian method to compute a smooth interpolation function on a point cloud in high dimensional space. The numerical results in semi-supervised learning and image inpainting show that the weighted graph Laplacian is a reliable and efficient interpolation method. In addition, it is easy to implement and faster than graph Laplacian.

In this paper, we show that every $(2^{n-1}+1)$-vertex induced subgraph of the $n$-dimensional cube graph has maximum degree at least $\sqrt{n}$. This result is best possible, and improves a logarithmic lower bound shown by Chung, F\"uredi, Graham and Seymour in 1988. As a direct consequence, we prove that the sensitivity and degree of a boolean function are polynomially related, solving an outstanding foundational problem in theoretical computer science, the Sensitivity Conjecture of Nisan and Szegedy.

In this paper, we attack the recent NIST submission Giophantus, a public key encryption scheme. We find that the complicated structure of Giophantus's ciphertexts leaks information via a correspondence from a low dimensional lattice. This allows us to distinguish encrypted data from random data by the LLL algorithm. This is a more efficient attack than previous proposed attacks.