We consider the solution of the rational matrix equations, or generalized algebraic Riccati equations with rational terms, arising in stochastic optimal control in continuous- and discrete-time. Fixed-point iteration and (modified) Newton's methods will be considered. In particular, the convergence results of a new modified Newton's method, for both continuous- and discrete-time rational Riccati equations, will be presented.

Recently there have two different effective methods proposed by Kanzow et al. in (Kanzow, 2001 [8]) and (Kanzow and Petra, 2004 [9]), respectively, which commonly use the FischerBurmeister (FB) function to recast the mixed complementarity problem (MCP) as a constrained minimization problem and a nonlinear system of equations, respectively. They all remark that their algorithms may be improved if the FB function is replaced by other NCP functions. Accordingly, in this paper, we employ the generalized FischerBurmeister (GFB) where the 2-norm in the FB function is relaxed to a general p-norm (p> 1) for the two methods and investigate how much the improvement is by changing the parameter p as well as which method is influenced more when we do so, by the performance profiles of iterations and function evaluations for the two methods with different p on MCPLIB collection.

We develop a multiscale tailored finite point method (MsTFPM) for second order elliptic equations with rough or highly oscillatory coefficients. The finite point method has been tailored to some particular properties of the problem, so that it can capture the multiscale solutions using coarse meshes without resolving the fine scale structure of the solution. Several numerical examples in one-and two-dimensions are provided to show the accuracy and convergence of the proposed method. In addition, some analysis results based on the maximum principle for the one-dimensional problem are proved.

We present a novel modification to the well-known infomax algorithm of blind source separation. Under natural gradient descent, the infomax algorithm converges to a stationary point of a limiting ordinary differential equation. However, due to the presence of saddle points or local minima of the corresponding likelihood function, the algorithm may be trapped around these bad stationary points for a long time, especially if the initial data are near them. To speed up convergence, we propose to add a sequence of random perturbations to the infomax algorithm to shake the iterating sequence so that it is captured by a path descending to a more stable stationary point. We analyze the convergence of the randomly perturbed algorithm, and illustrate its fast convergence through numerical examples on blind demixing of stochastic signals. The examples have analytical structures so that saddle points or local minima of

We propose to incorporate a weighted difference of anisotropic and isotropic total variation (TV) norms into a relaxed formulation of the two phase Mumford-Shah (MS) model for image segmentation. We show results exceeding those obtained by the MS model when using the standard TV norm to regularize partition boundaries. In particular, examples illustrating the qualitative differences between the proposed model and the standard MS one are shown. A fast numerical method is introduced to minimize the proposed model utilizing the difference-of-convex algorithm (DCA) and the primal dual hybrid gradient (PDHG) method.