In this paper, we present an efficient QR algorithm for solving the linear response eigenvalue problem H x= x, where H is -symmetric with respect to 0= diag (I n, I n). Based on newly introduced -orthogonal transformations, the QR algorithm preserves the -symmetric structure of H throughout the whole process, and thus guarantees the computed eigenvalues to appear pairwise (, ) as they should. With the help of a newly established implicit -orthogonality theorem, we incorporate the implicit multi-shift technique to accelerate the convergence of the QR algorithm. Numerical experiments are given to show the effectiveness of the algorithm.

We observe that Sturm’s error bounds readily imply that for semidefinite feasibility problems, the method of alternating projections converges at a rate of O(k^{-1/(2^{d+1}-2)}), where d is the singularity degree of the problem—the minimal number of facial reduction iterations needed to induce Slater’s condition. Consequently, for almost all such problems (in the sense of Lebesgue measure), alternating projections converge at a worst-case rate of O(1/k^{0.5}).

Stochastic gradient (SG) method has been popularly applied to solve optimization problems with objective that is stochastic or an average of many functions. Most existing works on SG assume that the underlying problem is unconstrained or has an easy-to-project constraint set. In this paper, we consider problems that have a stochastic objective and also many functional constraints. For such problems, it could be extremely expensive to project a point to the feasible set, or even compute subgradient and/or function value of all constraint functions. To find solutions of these problems, we propose a novel SG method based on the augmented Lagrangian function. Within every iteration, it inquires a stochastic subgradient of the objective, a subgradient and function value of one randomly sampled constraint function, and function value of another sampled constraint function. Hence, the per-iteration complexity is low. We establish its convergence rate for convex and also strongly convex problems. It can achieve the optimal O (1/\sqrt {k}) convergence rate for convex case and nearly optimal O (1/\sqrt {k}) rate for strongly convex case. Numerical experiments on quadratically constrained quadratic programming are conducted to demonstrate its efficiency.

No abstract uploaded!

No abstract uploaded!