We consider polynomial approximation on the unit sphere $\mathbb{S}^2=\{(x,y,z)\in \mathbb{R}^3:x^2+y^2+z^2=1\}$ by a class of regularized discrete least squares methods with novel choices for the regularization operator and the point sets of the discretization. We allow different kinds of rotationally invariant regularization operators, including the zero operator (in which case the approximation includes interpolation, quasi-interpolation, and hyperinterpolation); powers of the negative Laplace--Beltrami operator (which can be suitable when there are data errors); and regularization operators that yield filtered polynomial approximations. As node sets we use spherical $t$-designs, which are point sets on the sphere which when used as equal-weight quadrature rules integrate all spherical polynomials up to degree $t$ exactly. More precisely, we use well conditioned spherical $t$-designs obtained in a previous paper by maximizing the determinants of the Gram matrices subject to the spherical design constraint. For $t\ge 2L$ and an approximating polynomial of degree $L$ it turns out that there is no linear algebra problem to be solved and the approximation in some cases recovers known polynomial approximation schemes, including interpolation, hyperinterpolation, and filtered hyperinterpolation. For $t \in [L, 2L)$ the linear system needs to be solved numerically. Finally, we give numerical examples to illustrate the theoretical results and show that well chosen regularization operator and well conditioned spherical $t$-designs can provide good polynomial approximation on the sphere, with or without the presence of data errors.

In this paper, we propose a new stabilized linear finite element method for solving reaction-convection-diffusion equations with arbitrary magnitudes of reaction and diffusion. The key feature of the new method is that the test function in the stabilization term is taken in the adjoint-operator-like form $-\varepsilon \Delta v- ({\mbf a}\cdot\nabla v)/\gamma+\sigma v$, where the parameter $\gamma$ is appropriately designed to adjust the convection strength to achieve high accuracy and stability. We derive the stability estimates for the finite element solutions and establish the explicit dependence of $L^2$ and $H^1$ error bounds on the diffusivity, modulus of the convection field, reaction coefficient and the mesh size. The analysis shows that the proposed method is suitable for a wide range of mesh P\'{e}clet numbers and mesh Damk\"{o}hler numbers. More specifically, if the diffusivity $\varepsilon$ is sufficiently small with $\varepsilon < \Vert{\mbf a}\Vert h$ and the reaction coefficient $\sigma$ is large enough such that $\Vert{\mbf a}\Vert < \sigma h$, then the method exhibits optimal convergence rates in both $L^2$ and $H^1$ norms. However, for a small reaction coefficient satisfying $\Vert{\mbf a}\Vert \ge \sigma h$, the method behaves like the well-known streamline upwind/Petrov-Galerkin formulation of Brooks and Hughes. Several numerical examples exhibiting boundary or interior layers are given to demonstrate the high performance of the proposed method. Moreover, we apply the developed method to time-dependent reaction-convection-diffusion problems and simulation results show the efficiency of the approach.

This paper focuses on coordinate update methods, which are useful for solving problems involving large or high-dimensional datasets. They decompose a problem into simple subproblems, where each updates one, or a small block of, variables while fixing others. These methods can deal with linear and nonlinear mappings, smooth and nonsmooth functions, as well as convex and nonconvex problems. In addition, they are easy to parallelize. The great performance of coordinate update methods depends on solving simple sub-problems. To derive simple subproblems for several new classes of applications, this paper systematically studies coordinate-friendly operators that perform low-cost coordinate updates. Based on the discovered coordinate friendly operators, as well as operator splitting techniques, we obtain new coordinate update algorithms for a variety of problems in machine learning, image processing, as well as sub-areas of optimization. Several problems are treated with coordinate update for the first time in history. The obtained algorithms are scalable to large instances through parallel and even asynchronous computing. We present numerical examples to illustrate how effective these algorithms are.

In this paper, we propose a novel and simple technique to construct effective difference schemes for solving systems of singularly perturbed convection-diffusionreaction equations, whose solutions may display boundary or interior layers. We illustrate the technique by taking the Il’in-Allen-Southwell scheme for 1-D scalar equations as a basis to derive a formally second-order scheme for 1-D coupled systems and then extend the scheme to 2-D case by employing an alternating direction approach. Numerical examples are given to demonstrate the high performance of the obtained scheme on uniform meshes as well as piecewise-uniform Shishkin meshes.

This article studies the problem of image restoration of observed images corrupted by impulse noise and mixed Gaussian impulse noise. Since the pixels damaged by impulse noise contain no information about the true image, how to find this set correctly is a very important problem. We propose two methods based on blind inpainting and $\ell_0$ minimization that can simultaneously find the damaged pixels and restore the image. By iteratively restoring the image and updating the set of damaged pixels, these methods have better performance than other methods, as shown in the experiments. In addition, we provide convergence analysis for these methods; these algorithms will converge to coordinatewise minimum points. In addition, they will converge to local minimum points (or with probability one) with some modifications in the algorithms.