Multiple-correction and Faster Approximation

Xiaodong Cao,Hongmin Xu,Xu You

DOI: https://doi.org/10.48550/arXiv.1409.0968

2014-09-03

Abstract:In this paper, we formulate a new \emph{multiple-correction method}. The goal is to accelerate the rate of convergence. In particular, we construct some sequences to approximate the Euler-Mascheroni and Landau constants, which are faster than the classical approximations in literature.

Number Theory

What problem does this paper attempt to address?

Families of high-order simultaneous methods with several corrections

Stoil I. Ivanov

DOI: https://doi.org/10.1007/s11075-023-01734-3

IF: 2.37

2024-01-07

Numerical Algorithms

Abstract:In this paper, we propose the idea for combining several iteration functions in order to construct new families of iterative methods with both high-order of convergence and high computational efficiency. As an illustration, combining the most famous iteration functions with two or three arbitrary iteration functions, we obtain three new families of high-order iterative methods for the simultaneous computation of simple or multiple polynomial zeros. To demonstrate the influence of the different corrections and to show how one can manage the convergence order and the efficiency when constructing particular methods, we prove a local convergence theorem with a priori and a posteriori error estimates and an estimate of the asymptotic error constant about one of the proposed general families called Schröder-like methods with two corrections .

mathematics, applied
A Multilevel Correction Method for Convection-Diffusion Eigenvalue Problems

zhonglan peng,hai bi,hao li,yidu yang

DOI: https://doi.org/10.1155/2015/904347

IF: 1.43

2015-01-01

Mathematical Problems in Engineering

Abstract:We propose a multilevel correction method for the convection-diffusion eigenvalue problems which is suitable for not only simple but also multiple eigenvalues. And we prove that the accuracy of resulting eigenpair approximations can be improved after each correction step. The scheme is easy to realize with Matlab, and numerical results are satisfactory.
Lagrangian-based methods in convex optimization: prediction-correction frameworks with non-ergodic convergence rates

Tao Zhang,Yong Xia,Shiru Li

2023-04-05

Abstract:Lagrangian-based methods are classical methods for solving convex optimization problems with equality constraints. We present novel prediction-correction frameworks for such methods and their variants, which can achieve $O(1/k)$ non-ergodic convergence rates for general convex optimization and $O(1/k^2)$ non-ergodic convergence rates under the assumption that the objective function is strongly convex or gradient Lipschitz continuous. We give two approaches ($updating~multiplier~once$ $or~twice$) to design algorithms satisfying the presented prediction-correction frameworks. As applications, we establish non-ergodic convergence rates for some well-known Lagrangian-based methods (esp., the ADMM type methods and the multi-block ADMM type methods).

Optimization and Control
Solving separable convex optimization problems: Faster prediction-correction framework

Tao Zhang,Yong Xia,Shiru Li

2024-02-03

Abstract:He and Yuan's prediction-correction framework [SIAM J. Numer. Anal. 50: 700-709, 2012] is able to provide convergent algorithms for solving separable convex optimization problems at a rate of $O(1/t)$ ($t$ represents iteration times) in both ergodic (the average of iteration) and pointwise senses. This paper presents a faster prediction-correction framework at a rate of $O(1/t)$ in the non-ergodic sense (the last iteration) and $O(1/t^2)$ in the pointwise sense. Based the faster prediction-correction framework, we give three faster algorithms which enjoy $O(1/t)$ in the non-ergodic sense of primal-dual gap and $O(1/t^2)$ in the pointwise sense. The first algorithm updates dual variable twice when solving two-block separable convex optimization with equality linear constraints. The second algorithm solves multi-block separable convex optimization problems with linear equality constraints in Gauss-Seidel way. The third algorithm solves minmax problems with larger step sizes.

Optimization and Control
Kantorovich-Type Convergence Criterion for Inexact Newton Methods

Weiping Shen,Chong Li

DOI: https://doi.org/10.1016/j.apnum.2008.11.002

IF: 2.994

2009-01-01

Applied Numerical Mathematics

Abstract:Assuming that the first derivative of an operator satisfies the Lipschitz condition, a Kantorovich-type convergence criterion for inexact Newton methods is established, which includes the well-known Kantorovich's theorem as a special case. Comparisons and a numerical example are presented to illustrate that our results obtained in the present paper improve and extend some recent results in [X.P. Guo, On semilocal convergence of inexact Newton methods, J. Comput. Math. 25 (2007) 231–242; W.P. Shen, C. Li, Convergence criterion of inexact methods for operators with Hölder continuous derivatives, Taiwan. J. Math. 12 (2008) 1865–1882].
On Best Simultaneous Approximation

C Li,GA Watson

DOI: https://doi.org/10.1006/jath.1996.3102

IF: 0.993

1997-01-01

Journal of Approximation Theory

Abstract:The problem is considered of best approximation of finite number of functions simultaneously. For a very general class of norms, characterization results are derived. The main part of the paper is concerned with proving uniqueness and strong uniqueness theorems. For a particular subclass, which includes the important special case of the Chebyshev norm, a characterization is given of a uniqueness element.
Partly Approximate Iteration Technique For Accelerating Cg-Mlfma Solution

J Hu,Zp Nie,L Lin,W Jun,Gx Zou,J Hu

DOI: https://doi.org/10.1109/APS.2004.1330404

2004-01-01

Abstract:To further expedite the solution of conjugate gradient iteration-multilevel fast multipole algorithm (CG-MLFMA), a partly approximate iteration technique developed by us is applied in this paper. When the iterative error is low than the critical iteration error (CIE), the matrix-vector multiplication can be computed approximately by the interactions from nearby region. The CIE is determined by the contributions of nearby region and the accuracy required. Compared to the interactions from non-nearby region, the interactions from nearby region only possess a very small portion of total complexity Because iteration numbers needed in the present method does not increase dramatically, total CPU time can be reduced greatly. Numerical results are given to demonstrate the validity and efficiency of the present method.
Improving Geometric Iterative Approximation Methods Using Local Approximations

Pengbo Bo,Xiangjian Mai,Wenlong Meng,Caiming Zhang

DOI: https://doi.org/10.1016/j.cag.2023.08.001

2023-01-01

Abstract:In this study, we propose improvements to Geometric Iterative Methods (GIM) for curve and surface approximation. Our key contributions include introducing an error vector function and deriving new error vectors, which enhance the approximation quality compared to the Least Squared Progressive and Iterative Approximation (LSPIA) methods. Additionally, we integrate parameter correction and control points update based on local approximations, achieving comparable accuracy to Geometric Approximation (GA) methods while being more computationally efficient. Extensive experiments demonstrate the superior accuracy and computational efficiency of our method.
On Convergence Of A New Secant-Like Method For Solving Nonlinear Equations

Hongmin Ren,Qingbiao Wu,Weihong Bi

DOI: https://doi.org/10.1016/j.amc.2010.05.092

IF: 4.397

2010-01-01

Applied Mathematics and Computation

Abstract:In this paper, we prove that the order of a new secant-like method presented recently with the so-called order of 2.618 is only 2.414. Some mistakes in the derivation leading to such a conclusion are pointed out. Meanwhile, under the assumption that the second derivative of the involved function is bounded, the convergence radius of the secant-like method is given, and error estimates matching its convergence order are also provided by using a generalized Fibonacci sequence. (C) 2010 Elsevier Inc. All rights reserved.
Convergence Speed and Approximation Accuracy of Numerical MCMC

Tiangang Cui,Jing Dong,Ajay Jasra,Xin T. Tong

DOI: https://doi.org/10.48550/arXiv.2203.03104

2022-03-07

Abstract:When implementing Markov Chain Monte Carlo (MCMC) algorithms, perturbation caused by numerical errors is sometimes inevitable. This paper studies how perturbation of MCMC affects the convergence speed and Monte Carlo estimation accuracy. Our results show that when the original Markov chain converges to stationarity fast enough and the perturbed transition kernel is a good approximation to the original transition kernel, the corresponding perturbed sampler has similar convergence speed and high approximation accuracy as well. We discuss two different analysis frameworks: ergodicity and spectral gap, both are widely used in the literature. Our results can be easily extended to obtain non-asymptotic error bounds for MCMC estimators. We also demonstrate how to apply our convergence and approximation results to the analysis of specific sampling algorithms, including Random walk Metropolis and Metropolis adjusted Langevin algorithm with perturbed target densities, and parallel tempering Monte Carlo with perturbed densities. Finally we present some simple numerical examples to verify our theoretical claims.

Computation,Probability
Approximate construction of rational approximations and the effect of error autocorrection. Applications

Grigori Litvinov

DOI: https://doi.org/10.48550/arXiv.math/0101042

2001-01-05

Numerical Analysis

Abstract:Several construction methods for rational approximations to functions of one real variable are described in the present paper; the computational results that characterize the comparative accuracy of these methods are presented; an effect of error autocorrection is considered. This effect occurs in efficient methods of rational approximation (e.g., Pade approximations, linear and nonlinear Pade-Chebyshev approximations) where very significant errors in the coefficients do not affect the accuracy of the approximation. The matter of import is that the errors in the numerator and the denominator of a fractional rational approximant compensate each other. This effect is related to the fact that the errors in the coefficients of a rational approximant are not distributed in an arbitrary way but form the coefficients of a new approximant to the approximated function. Understanding of the error autocorrection mechanism allows to decrease this error by varying the approximation procedure depending on the form of the approximant. Some applications are described in the paper. In particular, a method of implementation of basic calculations on decimal computers that uses the technique of rational approximations is described in the Appendix. To a considerable extent the paper is a survey and the exposition is as elementary as possible.
Long-time Convergence of Numerical Approximations for Semilinear Parabolic Equations (Ⅰ)

Hai-jun WU,Rong-hua LI

DOI: https://doi.org/10.3969/j.issn.1674-5647.2000.01.014

2000-01-01

Abstract:The numerical approximations of the dynamical systems governed by semilinear parabolic equations are considered. An abstract framework for long-time error estimates is established. When applied to reaction-diffusion equation, Navier-Stokes equations and Chan Hilliard equation, approximated by Galerkin and nonlinear Galerkin methods in space and by Runge-Kutta method in time, our framework yields error estimates uniform in time.
An accelerated adaptive two-step Levenberg–Marquardt method with the modified Metropolis criterion

Dingyu Zhu,Yueting Yang,Mingyuan Cao

DOI: https://doi.org/10.3934/math.20241199

2024-01-01

AIMS Mathematics

Abstract:In this paper, aiming at the nonlinear equations, a new two-step Levenberg–Marquardt method was proposed. We presented a new Levenberg–Marquardt parameter to obtain the trial step. A new modified Metropolis criterion was used to adjust the upper bound of the approximate step. The convergence of the method was analyzed under the H$ \ddot{\rm o} $lderian local error bound condition and the H$ \ddot\rm o $lderian continuity of the Jacobian. Numerical experiments showed that the new algorithm is effective and competitive in the numbers of functions, Jacobian evaluations and iterations.

mathematics, applied
Multipliers Correction Methods for Optimization Problems over the Stiefel Manifold

Lei Wang,Bin Gao,Xin Liu

DOI: https://doi.org/10.4208/csiam-am.SO-2020-0008

2020-01-01

Abstract: We propose a class of multipliers correction methods to minimize a differentiable function over the Stiefel manifold. The proposed methods combine a function value reduction step with a proximal correction step. The former one searches along an arbitrary descent direction in the Euclidean space instead of a vector in the tangent space of the Stiefel manifold. Meanwhile, the latter one minimizes a first-order proximal approximation of the objective function in the range space of the current iterate to make Lagrangian multipliers associated with orthogonality constraints symmetric at any accumulation point. The global convergence has been established for the proposed methods. Preliminary numerical experiments demonstrate that the new methods significantly outperform other state-of-the-art first-order approaches in solving various kinds of testing problems.
Higher-Order Corrections to Optimisers based on Newton's Method

Stephen Brooks

2024-05-10

Abstract:The Newton, Gauss--Newton and Levenberg--Marquardt methods all use the first derivative of a vector function (the Jacobian) to minimise its sum of squares. When the Jacobian matrix is ill-conditioned, the function varies much faster in some directions than others and the space of possible improvement in sum of squares becomes a long narrow ellipsoid in the linear model. This means that even a small amount of nonlinearity in the problem parameters can cause a proposed point far down the long axis of the ellipsoid to fall outside of the actual curved valley of improved values, even though it is quite nearby. This paper presents a differential equation that `follows' these valleys, based on the technique of geodesic acceleration, which itself provides a 2$^\mathrm{nd}$ order improvement to the Levenberg--Marquardt iteration step. Higher derivatives of this equation are computed that allow $n^\mathrm{th}$ order improvements to the optimisation methods to be derived. These higher-order accelerated methods up to 4$^\mathrm{th}$ order are tested numerically and shown to provide substantial reduction of both number of steps and computation time.

Numerical Analysis
On the error estimates of several Newton-like methods1Partial supported by the National Natural Science Foundation of China and by Natural Science Foundation of Zhejiang Province.1

Zhengda Huang

DOI: https://doi.org/10.1016/S0096-3003(98)10085-1

IF: 4.397

1999-01-01

Applied Mathematics and Computation

Abstract:In this paper, convergence theorems and error estimates for several Newton-like iteration methods under new Kantorovitch-Ostrowski type conditions using the information of higher derivatives at initial point(s) are established. We get not only the convergence speed estimates of iterative sequence {x"n}, but also the estimates of f(x"n"+"1)/f(x"n).
Improved Finite Difference Method with a Compact Correction Term for Solving Poisson's Equations

Kun Zhang,Liangbi Wang,Yuwen Zhang

DOI: https://doi.org/10.1080/10407790.2016.1215715

2016-08-30

Abstract:An improved finite difference method with compact correction term is proposed to solve the Poisson equations. The compact correction term is developed by a coupled high-order compact and low-order classical finite difference formulations. The numerical solutions obtained by the classical finite difference method are considered as fundamental solutions with lower accuracy, whereas compact correction term is added into source term of classical discrete formulation to improve the accuracy of numerical solutions. The proposed method can be extended from two- to multi-dimensional cases straightforwardly. Numerical experiments are carried out to verify the accuracy and efficiency of this method.

Numerical Analysis
Approximation of the derivatives beyond Taylor expansion

Qiuyan Xu,Zhiyong Liu

DOI: https://doi.org/10.1016/j.camwa.2024.01.011

IF: 3.218

2024-01-25

Computers & Mathematics with Applications

Abstract:Different from the construction process of the traditional finite difference method, we derive a large class of high-accuracy methods for approximating derivatives. Since Taylor expansion is avoided, the requirement for function smoothness in the new methods is greatly reduced. We analyze the approximation errors of the proposed methods and compare their approximation effects. As a typical application, we use the proposed methods to solve Elliptic, Hyperbolic and Parabolic problems numerically. For time-dependent problems, a class of new fully implicit difference schemes and the fourth-order Runge-Kutta method are both used for discretization . When using fully implicit difference schemes, unconditional stability and convergence are proved for hyperbolic and parabolic problems with the periodic boundary conditions. A large number of numerical experiments are provided to demonstrate the theoretical results.

mathematics, applied
On accelerating a multilevel correction adaptive finite element method for Kohn-Sham equation

Guanghui Hu,Hehu Xie,Fei Xu

DOI: https://doi.org/10.1016/j.jcp.2022.111674

IF: 4.645

2023-01-01

Journal of Computational Physics

Abstract:Based on the numerical method proposed in Hu et al. (2018) [22] for Kohn-Sham equation, further improvement on the efficiency is obtained in this paper by i). designing a numerical method with the strategy of separately handling the nonlinear Hartree potential and exchange-correlation potential, and ii). parallelizing the algorithm in an eigenpairwise approach. The feasibility of two approaches is analyzed in detail, and the new algorithm is described completely. Compared with previous results, a significant improvement of numerical efficiency can be observed from plenty of numerical experiments, which make the new method more suitable for the practical problems.

physics, mathematical,computer science, interdisciplinary applications
Some Substantial Modifications and Improvements for Derivative-Free Iterative Methods and Derivative-Free Transformation for Multiple Zeros

Xinyuan Wu,Jianlin Xia

DOI: https://doi.org/10.1016/j.amc.2006.02.036

IF: 4.397

2006-01-01

Applied Mathematics and Computation

Abstract:In this paper we present some substantial modifications and improvements for some derivative-free iterative formulae. We propose some new methods which are convergent iterative formulae of order 1 + root 2 approximate to 2.414 with only two evaluations of f per step. Thus the new methods enjoy the efficiency index root(1 + root 2) approximate to 1.554. Especially, a new method of self-accelerating regula falsi type with global convergence for finding a simple root p of a nonlinear equation f(x) = 0 in the interval [a, b] is offered in this paper. The new method of self-accelerating regula falsi type is shown to be convergent with order 1 + root 2 approximate to 2.414 for both the sequences of diameters {(b(n) - a(n))} and the iterative points {x(n)}. The new method has been tested on a series of published examples. The numerical results demonstrate that the new method is more effective. Furthermore, we introduce a derivative-free transformation for multiple zeros and consider its error analysis and then demonstrate its superiority by comparing it with the traditional ones. (c) 2006 Published by Elsevier Inc.

Multiple-correction and Faster Approximation

Families of high-order simultaneous methods with several corrections

A Multilevel Correction Method for Convection-Diffusion Eigenvalue Problems

Lagrangian-based methods in convex optimization: prediction-correction frameworks with non-ergodic convergence rates

Solving separable convex optimization problems: Faster prediction-correction framework

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

On Best Simultaneous Approximation

Partly Approximate Iteration Technique For Accelerating Cg-Mlfma Solution

Improving Geometric Iterative Approximation Methods Using Local Approximations

On Convergence Of A New Secant-Like Method For Solving Nonlinear Equations

Convergence Speed and Approximation Accuracy of Numerical MCMC

Approximate construction of rational approximations and the effect of error autocorrection. Applications

Long-time Convergence of Numerical Approximations for Semilinear Parabolic Equations (Ⅰ)

An accelerated adaptive two-step Levenberg–Marquardt method with the modified Metropolis criterion

Multipliers Correction Methods for Optimization Problems over the Stiefel Manifold

Higher-Order Corrections to Optimisers based on Newton's Method

On the error estimates of several Newton-like methods1Partial supported by the National Natural Science Foundation of China and by Natural Science Foundation of Zhejiang Province.1

Improved Finite Difference Method with a Compact Correction Term for Solving Poisson's Equations

Approximation of the derivatives beyond Taylor expansion

On accelerating a multilevel correction adaptive finite element method for Kohn-Sham equation

Some Substantial Modifications and Improvements for Derivative-Free Iterative Methods and Derivative-Free Transformation for Multiple Zeros