No abstract uploaded!

No abstract uploaded!

No abstract uploaded!

A new Tikhonov regularization method of Fuhry and Reichel [A new Tikhonov regularization method, Numerical Algorithms, 59:433-445, 2011] exhibits the excellent properties for ill-posed problems, but it can only deal with small or moderate size problems because of the expensive computation of singular value decomposition (SVD). In this paper, we extend the above new Tikhonov regularization method to solve large-scale problems, e.g., image restoration problem with periodic boundary conditions, and realize this extending by applying Fast Fourier Transformation (FFT) algorithm to the spectral decomposition of the block circulant with circulant blocks (BCCB) matrices. Experimental results confirm the superiority of our new method.

For a Lagrangian scheme solving the compressible Euler equations in cylindrical coordinates, two important issues are whether the scheme can maintain spherical symmetry (symmetry-preserving) and whether the scheme can maintain positivity of density and internal energy (positivity-preserving). While there were previous results in the literature either for symmetry-preserving in the cylindrical coordinates or for positivity-preserving in cartesian coordinates, the design of a Lagrangian scheme in cylindrical coordinates, which is high order in one-dimension and second order in two-dimensions, and can maintain both spherical symmetry-preservation and positivity-preservation simultaneously, is challenging. In this paper we design such a Lagrangian scheme and provide numerical results to demonstrate its good behavior.

In earlier work, two of the authors constructed uniformly high order accurate finite volume and discontinuous Galerkin (DG) schemes satisfying a strict maximum principle for scalar conservation laws on rectangular meshes. The technique is generalized to positivity preserving (of density and pressure) high order DG or finite volume schemes for compressible Euler equations. The extension of these schemes to triangular meshes is conceptually plausible but highly nontrivial. In this paper, we first introduce a special quadrature rule which is exact for two-variable polynomials over a triangle of a given degree and satisfy a few other conditions, by which we can construct high order maximum principle satisfying finite volume schemes (e.g. essentially non-oscillatory (ENO) or weighted ENO (WENO) schemes) or DG method solving two dimensional scalar conservation laws on triangular meshes. The same method can preserve the maximum principle for DG or finite volume schemes solving two-dimensional incompressible Euler equations in the vorticity stream-function formulation, or any passive convection equation with an incompressible velocity field. We also obtain positivity preserving (for density and pressure) high order DG or finite volume schemes solving compressible Euler equations on triangular meshes. Numerical tests for the third order Runge-Kutta DG (RKDG) method on unstructured meshes are reported.

We study a nonlinear weighted least-squares finite element method for the Navier- Stokes equations governing non-Newtonian fluid flows by using the Carreau- Yasuda model. The Carreau-Yasuda model is used to describe the shear-thinning behavior of blood. We prove that the least-squares approximation converges to linearized solutions of the non-Newtonian model at the optimal rate. By using continuous piecewise linear finite element spaces for all variables and by appropriately adjusting the nonlinear weighting function, we obtain optimal L2-norm error convergence rates in all variables. Numerical results are given for a Carreau fluid in the 4-to-1 contraction problem, revealing the shear-thinning behavior. The physical parameter effects are also investigated.

Positivity-preserving discontinuous Galerkin (DG) methods for solving hyperbolic conservation laws have been extensively studied in the last several years. But nearly all the developed schemes are coupled with explicit time discretizations. Explicit discretizations suffer from the constraint for the Courant-Friedrichs-Levis (CFL) number. This makes explicit methods impractical for problems involving unstructured and extremely varying meshes or long-time simulations. Instead, implicit DG schemes are often popular in practice, especially in the computational fluid dynamics (CFD) community. In this paper we develop a high-order positivity-preserving DG method with the backward Euler time discretization for conservation laws. We focus on one spatial dimension, however the result easily generalizes to multidimensional tensor product meshes and polynomial spaces. This work is based on a generalization of the positivity-preserving limiters in (X. Zhang and C.-W. Shu, Journal of Computational Physics, 229 (2010), pp.~3091--3120) and (X. Zhang and C.-W. Shu, Journal of Computational Physics, 229 (2010), pp.~8918--8934) to implicit time discretizations. Both the analysis and numerical experiments indicate that a lower bound for the CFL number is required to obtain the positivity-preserving property. The proposed scheme not only preserves the positivity of the numerical approximation without compromising the designed high-order accuracy, but also helps accelerate the convergence towards the steady-state solution and add robustness to the nonlinear solver. Numerical experiments are provided to support these conclusions.

Discontinuous Galerkin (DG) methods combine features in finite element methods (weak formulation, finite dimensional solution and test function spaces) and in finite volume methods (numerical fluxes, nonlinear limiters) and are particularly suitable for simulating convection dominated problems, such as linear and nonlinear waves including shock waves. In this article we will give a brief survey of DG methods, emphasizing their applications in computational fluid dynamics (CFD). We will discuss essential ingredients and properties of DG methods, and will also give a few examples of recent developments of DG methods which have facilitated their applications in CFD.

Finding the stationary states of a free energy functional is an important problem in phase field crystal (PFC) models. Many efforts have been devoted to designing numerical schemes with energy dissipation and mass conservation properties. However, most existing approaches are time-consuming due to the requirement of small effective step sizes. In this paper, we discretize the energy functional and propose efficient numerical algorithms for solving the constrained nonconvex minimization problem. A class of gradient-based approaches, which are the so-called adaptive accelerated Bregman proximal gradient (AA-BPG) methods, is proposed, and the convergence property is established without the global Lipschitz constant requirements. A practical Newton method is also designed to further accelerate the local convergence with convergence guarantee. One key feature of our algorithms is that the energy dissipation and mass conservation properties hold during the iteration process. Moreover, we develop a hybrid acceleration framework to accelerate the AA-BPG methods and most of the existing approaches through coupling with the practical Newton method. Extensive numerical experiments, including two three-dimensional periodic crystals in the Landau--Brazovskii (LB) model and a two-dimensional quasicrystal in the Lifshitz--Petrich (LP) model, demonstrate that our approaches have adaptive step sizes which lead to a significant acceleration over many existing methods when computing complex structures.

No abstract uploaded!

No abstract uploaded!

In this article, we propose two numerical methods, the Gaussian Process (GP) method and the Fourier Features (FF) algorithm, to solve mean field games (MFGs). The GP algorithm approximates the solution of a MFG with maximum a posteriori probability estimators of GPs conditioned on the partial differential equation (PDE) system of the MFG at a finite number of sample points. The main bottleneck of the GP method is to compute the inverse of a square gram matrix, whose size is proportional to the number of sample points. To improve the performance, we introduce the FF method, whose insight comes from the recent trend of approximating positive definite kernels with random Fourier features. The FF algorithm seeks approximated solutions in the space generated by sampled Fourier features. In the FF method, the size of the matrix to be inverted depends only on the number of Fourier features selected, which is much less than the size of sample points. Hence, the FF method reduces the precomputation time, saves the memory, and achieves comparable accuracy to the GP method. We give the existence and the convergence proofs for both algorithms. The convergence argument of the GP method does not depend on any monotonicity condition, which suggests the potential applications of the GP method to solve MFGs with non-monotone couplings in future work. We show the efficacy of our algorithms through experiments on a stationary MFG with a non-local coupling and on a time-dependent planning problem. We believe that the FF method can also serve as an alternative algorithm to solve general PDEs.

We propose a computational efficient yet simple numerical algorithm to solve the surface eikonal equation on general implicit surfaces. The method is developed based on the embedding idea and the fast sweeping methods. We first approximate the solution to the surface eikonal equation by the Euclidean weighted distance function defined in a tubular neighbourhood of the implicit surface, and then apply the efficient fast sweeping method to numerically compute the corresponding viscosity solution. Unlike some other embedding methods which require the radius of the computational tube satisfies h = O ( x ) for some h = O ( x ) , our approach allows h = O ( x ) . This implies that the total number of grid points in the computational tube is optimal and is given by h = O ( x ) for a co-dimensional one surface in h = O ( x ) . The method can be easily extended to general static HamiltonJacobi equation defined on implicit

The main purpose of this paper is to analyze the stability and error estimates of the local discontinuous Galerkin (LDG) methods coupled with carefully chosen implicit-explicit (IMEX) Runge-Kutta time discretization up to third order accuracy, for solving one-dimensional linear advection-diffusion equations. In the time discretization the advection term is treated explicitly and the diffusion term implicitly. There are three highlights of this work. The first is that we establish an important relationship between the gradient and interface jump of the numerical solution with the independent numerical solution of the gradient in the LDG methods. The second is that, by aid of the aforementioned relationship and the energy method, we show that the IMEX LDG schemes are unconditionally stable for the linear problems, in the sense that the time-step $\dt$ is only required to be upper-bounded by a constant which depends on the ratio of the diffusion and the square of the advection coefficients and is independent of the mesh-size $h$, even though the advection term is treated explicitly. The last is that under this time step condition, we obtain optimal error estimates in both space and time for the third order IMEX Runge-Kutta time-marching coupled with LDG spatial discretization. Numerical experiments are also given to verify the main results.

In this paper, we propose a novel low dimensional manifold model (LDMM) and apply it to some image processing problems. LDMM is based on the fact that the patch manifolds of many natural images have low dimensional structure. Based on this fact, the dimension of the patch manifold is used as a regularization to recover the image. The key step in LDMM is to solve a Laplace-Beltrami equation over a point cloud which is solved by the point integral method. The point integral method enforces the sample point constraints correctly and gives better results than the standard graph Laplacian. Numerical simulations in image denoising, inpainting and super-resolution problems show that LDMM is a powerful method in image processing.

The positivity-preserving property is an important and challenging issue for the numerical solution of radiative transfer equations. In the past few decades, different numerical techniques have been proposed to guarantee positivity of the radiative intensity in several schemes, however it is difficult to maintain both high order accuracy and positivity. The discontinuous Galerkin (DG) finite element method is a high order numerical method which is widely used to solve the neutron/photon transfer equations, due to its distinguished advantages such as high order accuracy, geometric flexibility, suitability for $h$- and $p$-adaptivity, parallel efficiency, and a good theoretical foundation for stability and error estimates. In this paper, we construct arbitrarily high order accurate DG schemes which preserve positivity of the radiative intensity in the simulation of both steady and unsteady radiative transfer equations in one- and two-dimensional geometry by using a combined technique of the scaling positivity-preserving limiter in \cite{ZS2} and a new rotational positivity-preserving limiter. This combined limiter is simple to implement and we prove the properties of positivity-preserving and high order accuracy rigorously. One- and two-dimensional numerical results are provided to verify the good properties of the positivity-preserving DG schemes.

No abstract uploaded!

In this paper we integrate semi-local patches and the weighted graph Laplacian into the framework of the low dimensional manifold model. This approach is much faster than the original LDMM algorithm. The number of iterations is typically reduced from 100 to 10 and the equations in each step are much easier to solve. This new approach is tested in image inpainting and denoising and the results are better than the original LDMM and competitive with state-of-the-art methods.

Motivated by big data applications, first-order methods have been extremely popular in recent years. However, naive gradient methods generally converge slowly. Hence, much efforts have been made to accelerate various first-order methods. This paper proposes two accelerated methods towards solving structured linearly constrained convex programming, for which we assume composite convex objective that is the sum of a differentiable function and a possibly nondifferentiable one. The first method is the accelerated linearized augmented Lagrangian method (LALM). At each update to the primal variable, it allows linearization to the differentiable function and also the augmented term, and thus it enables easy subproblems. Assuming merely convexity, we show that LALM owns O(1/t) convergence if parameters are kept fixed during all the iterations and can be accelerated to O(1/t^2) if the parameters are adapted, where t is the number of total iterations. The second method is the accelerated linearized alternating direction method of multipliers (LADMM). In addition to the composite convexity, it further assumes two-block structure on the objective. Different from classic ADMM, our method allows linearization to the objective and also augmented term to make the update simple. Assuming strong convexity on one block variable, we show that LADMM also enjoys O(1=t2) convergence with adaptive parameters. This result is a significant improvement over that in [Goldstein et. al, SIIMS'14], which requires strong convexity on both block variables and no linearization to the objective or augmented term. Numerical experiments are performed on quadratic programming, image denoising, and support vector machine. The proposed accelerated methods are compared to nonaccelerated ones and also existing accelerated methods. The results demonstrate the validness of acceleration and superior performance of the proposed methods over existing ones.

In our earlier work, we constructed uniformly high order accurate discontinuous Galerkin (DG) and finite volume schemes which preserve positivity of density and pressure for the Euler equations of compressible gas dynamics. In this paper, we present an extension of this framework to construct positivity-preserving high order essentially non-oscillatory (ENO) and weighted essentially non-oscillatory (WENO) finite difference schemes for compressible Euler equations. General equations of state and source terms are also discussed. Numerical tests of the fifth order finite difference WENO scheme are reported to demonstrate the good behavior of such schemes.

H(div) conforming and discontinuous Galerkin (DG) methods are designed for incompressible Euler's equation in two and three dimension. Error estimates are proved for both the semi-discrete method and fully-discrete method using backward Euler time stepping. Numerical examples exhibiting the performance of the methods are given.

No abstract uploaded!

No abstract uploaded!

Kurdyka–Łojasiewicz (KL) exponent plays an important role in estimating the convergence rate of many contemporary first-order methods. In particular, a KL exponent of 1/2 for a suitable potential function is related to local linear convergence. Nevertheless, KL exponent is in general extremely hard to estimate. In this paper, we show under mild assumptions that KL exponent is preserved via inf-projection. Inf-projection is a fundamental operation that is ubiquitous when reformulating optimization problems via the lift-and-project approach. By studying its operation on KL exponent, we show that the KL exponent is 1/2 for several important convex optimization models, including some semidefinite-programming-representable functions and some functions that involve C2-cone reducible structures, under conditions such as strict complementarity. Our results are applicable to concrete optimization models such as group-fused Lasso and overlapping group Lasso. In addition, for nonconvex models, we show that the KL exponent of many difference-of-convex functions can be derived from that of their natural majorant functions, and the KL exponent of the Bregman envelope of a function is the same as that of the function itself. Finally, we estimate the KL exponent of the sum of the least squares function and the indicator function of the set of matrices of rank at most k.