A Regularization Algorithm for Zero Points of Accretive Operators

Yuan Qing,Sun Young Cho

DOI: https://doi.org/10.1186/1687-1812-2013-341

2013-01-01

Fixed Point Theory and Applications

Abstract:A regularization algorithm with a computational error for treating accretive operators is investigated. A strong convergence theorem for zero points of accretive operators is established in a reflexive Banach space.

What problem does this paper attempt to address?

Rates of convergence for iterative solutions of equations involving set-valued accretive operators

Ulrich Kohlenbach,Thomas Powell

DOI: https://doi.org/10.1016/j.camwa.2020.04.002

2020-04-24

Abstract:This paper studies proofs of strong convergence of various iterative algorithms for computing the unique zeros of set-valued accretive operators that also satisfy some weak form of uniform accretivity at zero. More precisely, we extract explicit rates of convergence from these proofs which depend on a modulus of uniform accretivity at zero, a concept first introduced by A. Koutsoukou-Argyraki and the first author in 2015. Our highly modular approach, which is inspired by the logic-based proof mining paradigm, also establishes that a number of seemingly unrelated convergence proofs in the literature are actually instances of a common pattern.

Optimization and Control,Functional Analysis,Logic
Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Jinhua Wang,Chong Li,K. F. Ng

DOI: https://doi.org/10.1137/22M152147X

2023-01-01

Abstract:We study the issue of strong convergence of inexact proximal point algorithms (introduced by Rockafellar in [SIAM J. Control Optim., 14 (1976), pp. 877-898]) for maximal monotone operators on Hilbert spaces. A unified global/local strong convergence of inexact proximal point algorithms is established under the Holder metrically subregular condition. Furthermore, quantitative estimates on the convergence rate of inexact proximal point algorithms are also provided. Applying to the special case of the classical (exact) proximal point algorithm, our results improve the corresponding ones in [G. Li and B. S. Mordukhovich, SIAM J. Optim., 22 (2012), pp. 1655-1684]. Finally, as applications, global/local strong convergence and estimates on the convergence rate of inexact proximal point algorithms for optimization problems are presented.
Strong Convergence of a Parallel Iterative Algorithm in a Reflexive Banach Space

Quan Yuan,Songtao Lv

DOI: https://doi.org/10.1186/1687-1812-2014-125

2014-01-01

Fixed Point Theory and Applications

Abstract:In this paper, a parallel iterative algorithm is investigated for common zeros of a family of m-accretive operators. Strong convergence theorems are established in a reflexive Banach space. MSC:47H06, 47H09.
A novel algorithm with an inertial technique for fixed points of nonexpansive mappings and zeros of accretive operators in Banach spaces

Kaiwich Baewnoi,Damrongsak Yambangwai,Tanakit Thianwan

DOI: https://doi.org/10.3934/math.2024313

2024-01-01

AIMS Mathematics

Abstract:The purpose of this paper was to prove that a novel algorithm with an inertial approach, used to generate an iterative sequence, strongly converges to a fixed point of a nonexpansive mapping in a real uniformly convex Banach space with a uniformly Gâteaux differentiable norm. Furthermore, zeros of accretive mappings were obtained. The proposed algorithm has been implemented and tested via numerical simulation in MATLAB. The simulation results showed that the algorithm converges to the optimal configurations and shows the effectiveness of the proposed algorithm.

mathematics, applied
Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Hu Yaohua,Li Chong,Meng Kaiwen,Yang Xiaoqi

DOI: https://doi.org/10.1007/s10898-020-00955-3

2020-01-01

Journal of Global Optimization

Abstract:The ℓ _p regularization problem with 0< p< 1 has been widely studied for finding sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. The proximal gradient algorithm is one of the most popular algorithms for solving the ℓ _p regularisation problem. In the present paper, we investigate the linear convergence issue of one inexact descent method and two inexact proximal gradient algorithms (PGA). For this purpose, an optimality condition theorem is explored to provide the equivalences among a local minimum, second-order optimality condition and second-order growth property of the ℓ _p regularization problem. By virtue of the second-order optimality condition and second-order growth property, we establish the linear convergence properties of the inexact descent method and inexact PGAs under some simple assumptions. Both linear convergence to a local minimal value and linear convergence to a local minimum are provided. Finally, the linear convergence results of these methods are extended to the infinite-dimensional Hilbert spaces. Our results cannot be established under the framework of Kurdyka–Łojasiewicz theory.
Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Jinhua Wang,Chong Li,Genaro Lopez,Jen-Chih Yao

DOI: https://doi.org/10.1137/15m1051257

IF: 2.763

2016-01-01

SIAM Journal on Optimization

Abstract:In the present paper, we consider inexact proximal point algorithms for finding singular points of multivalued vector fields on Hadamard manifolds. The rate of convergence is shown to be linear under the mild assumption of metric subregularity. Furthermore, if the sequence of parameters associated with the iterative scheme converges to 0, then the convergence rate is superlinear. At the same time, the finite termination of the inexact proximal point algorithm is also provided under a weak sharp minima-like condition. Applications to optimization problems are provided. Some of our results are new even in Euclidean spaces, while others improve and/or extend some known results in Euclidean spaces. As a matter of fact, in the case of exact proximal point algorithm, our results improve the corresponding results in [G. C. Bento and J. X. Cruz Neto, Opttm., 63 (2014), pp. 1281-1288]. Finally, several examples are provided to illustrate that our results are applicable while the corresponding results in the Hilbert space setting are not.
Variational-like inclusion problems involving A-maximal m-relaxed η-accretive mappings in the sense of s.i.p. and fixed point problems

J. Balooee,S. Al-Homidan,J. F. Tang,S. S. Chang,J. C. Yao

DOI: https://doi.org/10.1080/02331934.2024.2331791

IF: 2.2

2024-03-27

Optimization

Abstract:This paper is devoted to the introduction of a new class of accretive mappings in the framework of q -uniformly smooth Banach spaces called A -maximal m -relaxed η -accretive mappings in the sense of semi-inner product of type (p) (for short, s.i.p.(p)). The resolvent operator associated with such a mapping is defined; its Lipschitz continuity is proved and an estimate of its Lipschitz constant is computed under some suitable conditions. At the same time, the problem of finding a common element of the set of fixed points of a given nearly asymptotically nonexpansive mapping and the set of solutions of a variational-like inclusion problem involving A -maximal m -relaxed η -accretive mappings in the sense of s.i.p.(p) is investigated. To achieve this goal, a new iterative algorithm is constructed. Using the notions of graph convergence and resolvent operator associated with an A -maximal m -relaxed η -accretive mapping in the sense of s.i.p.(p), a new equivalence relationship between the graph convergence and the resolvent operator convergence of a sequence of A -maximal m -relaxed η -accretive mappings in the sense of s.i.p.(p) is established. As an application of this equivalence, the strong convergence of the sequence generated by our proposed iterative algorithm to a common point of the above two sets is demonstrated under some suitable assumptions imposed on the parameters. The results presented in this paper unify, improve and generalize some recent works in this field.

mathematics, applied,operations research & management science
A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Xinghua Wang,Chong Li,Ming-Jun Lai

DOI: https://doi.org/10.1023/A:1021986506085

IF: 1.856

2002-01-01

BIT Numerical Mathematics

Abstract:The paper is concerned with the convergence problem of Newton type methods for finding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators redefined by different Lipschitz conditions and an “universal constant” is introduced so that unified convergence determination of these methods is established for the defined families.
Relative Regularity Conditions and Linear Regularity Properties for Split Feasibility Problems in Normed Linear Spaces

Jinhua Wang,Tianming Gao,Chong Li,Xiaoqi Yang

DOI: https://doi.org/10.1016/j.jmaa.2023.127982

IF: 1.417

2024-01-01

Journal of Mathematical Analysis and Applications

Abstract:The bounded linear regularity property plays a key role in the study of the strong convergence and/or convergence rate of the CQ algorithm for solving split feasibility problems. To establish some sufficient conditions ensuring the bounded linear regularity property for split feasibility problems in normed linear spaces, we introduce the notion of a relative regularity condition and its associated relative regularity constant in spirit of the regularity condition used in Burke and Ferris (1995) [12]. Based on convex analysis techniques, we explore equivalent characterizations of the relative regularity condition, which in particular extend the classical results in Burke and Ferris (1995) [12] from the Euclidean space to general normed linear spaces, and then establish some important and useful properties in terms of the related relative regularity constant. Consequently, we develop a new technique to establish some sufficient conditions ensuring the bounded linear regularity property for split feasibility problems in normed linear spaces. The sufficient conditions presented in this paper are in terms of the relative regularity constant, which seem completely new. Applied to the case of Hilbert spaces, our results extend and improve the corresponding ones in Wang et al. (2017) [35] by relaxing the relevant assumptions.(c) 2023 Elsevier Inc. All rights reserved.
Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Jinhua Wang,Chong Li,Genaro Lopez,Jen-Chih Yao

DOI: https://doi.org/10.1007/s10898-014-0182-2

2014-01-01

Journal of Global Optimization

Abstract:Inexact proximal point methods are extended to find singular points for multivalued vector fields on Hadamard manifolds. Convergence criteria are established under some mild conditions. In particular, in the case of proximal point algorithm, that is, ε _n=0 for each n , our results improve sharply the corresponding results in Li et al. ( 2009 ). Applications to optimization problems, variational inequality problems and gradient methods are also given.
Convergence Rate of the Relaxed CQ Algorithm under Hölderian Type Error Bound Property

Lufang Zhang,Jinhua Wang,Chong Li,Xiaoqi Yang

DOI: https://doi.org/10.1080/02331934.2022.2154606

IF: 2.2

2024-01-01

Optimization

Abstract:The relaxed CQ algorithm is one of the most important algorithms for solving the split feasibility problem. We study the issue of strong convergence of the relaxed CQ algorithm in Hilbert spaces together with estimates on the convergence rate. Under a kind of Holderian type bounded error bound property, strong convergence of the relaxed CQ algorithm is established. Furthermore, qualitative estimates on the convergence rate is presented. In particular, for the case when the involved exponent is equal to 1, the linear convergence of the relaxed CQ algorithm is established. Finally, numerical experiments are performed to show the convergence property of the relaxed CQ algorithm for the compressed sensing problem.
An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Xinghua Wang,Chong Li

2007-01-01

Abstract:The paper is concerned with the convergence problem of Newton's type methods for nding zeros of nonlinear operators in Banach spaces. Some families of nonlinear operators are de ned by di erent Lipschitz conditions and an \universal constant" is introduced so that an uni ed convergence determination of these methods is established for the de ned families.
Rates of Convergence and Metastability for Chidume's Algorithm for the Approximation of Zeros of Accretive Operators in Banach Spaces

Richard Findling,Ulrich Kohlenbach,Richard FindlingUlrich KohlenbachDepartment of Mathematics,Technische Universität Darmstadt,Darmstadt,Germany

DOI: https://doi.org/10.1080/01630563.2024.2318597

2024-02-29

Numerical Functional Analysis and Optimization

Abstract:In this paper we give a quantitative analysis of an explicit iteration method due to C.E. Chidume for the approximation of a zero of an m -accretive operator A:X→2X in Banach spaces which does not involve the computation of the resolvent of A .

mathematics, applied
Porosity of perturbed optimization problems in Banach spaces

Chong Li,Li Hui Peng

DOI: https://doi.org/10.1016/j.jmaa.2005.12.030

IF: 1.417

2006-01-01

Journal of Mathematical Analysis and Applications

Abstract:Let X be a Banach space and Z a nonempty closed subset of X. Let J:Z→R be a lower semicontinuous function bounded from below. This paper is concerned with the perturbed optimization problem infz∈Z{J(z)+‖x−z‖}, denoted by (x,J)-inf for x∈X. In the case when X is compactly fully 2-convex, it is proved in the present paper that the set of all points x in X for which there does not exist z0∈Z such that J(z0)+‖x−z0‖=infz∈Z{J(z)+‖x−z‖} is a σ-porous set in X. Furthermore, if X is assumed additionally to be compactly locally uniformly convex, we verify that the set of all points x∈X∖Z0 such that the problem (x,J)-inf fails to be approximately compact, is a σ-porous set in X∖Z0, where Z0 denotes the set of all z∈Z such that z∈PZ(z). Moreover, a counterexample to which some results of Ni [R.X. Ni, Generic solutions for some perturbed optimization problem in nonreflexive Banach space, J. Math. Anal. Appl. 302 (2005) 417–424] fail is provided.
Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

J. H. Wang,C. Li,J.-C. Yao

DOI: https://doi.org/10.1007/s10957-014-0689-1

2014-01-01

Journal of Optimization Theory and Applications

Abstract:In the present paper, we study the finite termination of sequences generated by inexact proximal point algorithms for finding zeroes of a maximal monotone (set-valued) operator T on a Hilbert space. Under some mild conditions, we get that a sequence generated by inexact proximal point algorithm stops after a finite number of iterations. Our results extend the corresponding results in Rockafellar (SIAM J Control Optim 14:877–898, 1976 ). In particular, for optimization problems, our results improve corresponding results in Ferris (Math Progr 50:359–366, 1991 ). As applications, we obtain finite termination of projected gradient method.
A UNIFIED AND TIGHT LINEAR CONVERGENCE ANALYSIS OF THE RELAXED PROXIMAL POINT ALGORITHM

Guoyong Gu,Junfeng Yang

DOI: https://doi.org/10.3934/jimo.2022107

2023-01-01

Journal of Industrial and Management Optimization

Abstract:Finding a zero of a maximal monotone operator is fundamental in convex optimization and monotone operator theory, and proximal point algorithm (PPA) is a primary method for solving this problem. PPA converges not only globally under fairly mild conditions but also asymptotically at a fast linear rate provided that the underlying inverse operator is Lipschitz continuous at the origin. These nice convergence properties are preserved by a relaxed variant of PPA. Recently, a linear convergence bound was established in [M. Tao, and X. M. Yuan, J. Sci. Comput., 74 (2018), pp. 826-850] for the relaxed PPA, and it was shown that the bound is tight when the relaxation factor gamma lies in [1, 2). However, for other choices of gamma, the bound obtained by Tao and Yuan is suboptimal. In this paper, we establish tight linear convergence bounds for any choice of gamma is an element of (0, 2) using a unified and much simplified analysis. These results sharpen our understandings to the asymptotic behavior of the relaxed PPA and make the whole picture for gamma is an element of (0, 2) clear.
Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

Wei Wang,Shuai Lu,Bernd Hofmann,Jin Cheng

DOI: https://doi.org/10.1515/jiip-2019-0008

IF: 1.4479

2019-01-01

Journal of Inverse and Ill-Posed Problems

Abstract:Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed operator equations Ax = y with an injective and bounded linear operator A mapping between l^2 and a Banach space Y are regularized. For sparse solutions, error estimates as well as linear and sublinear convergence rates are derived based on a variational inequality approach, where the regularization parameter can be chosen either a priori in an appropriate way or a posteriori by the sequential discrepancy principle. To further illustrate the balance between the l^0-term and the complementing convex penalty, the important special case of the l^2-norm square penalty is investigated showing explicit dependence between both terms. Finally, some numerical experiments verify and illustrate the sparsity promoting properties of corresponding regularized solutions.
On computational properties of Cauchy problems generated by accretive operators

Pedro Pinto,Nicholas Pischke

2023-10-11

Abstract:In this paper, we provide quantitative versions of results on the asymptotic behavior of nonlinear semigroups generated by an accretive operator due to O. Nevanlinna and S. Reich as well as H.-K. Xu. These results themselves rely on a particular assumption on the underlying operator introduced by A. Pazy under the name of `convergence condition'. Based on logical techniques from `proof mining', a subdiscipline of mathematical logic, we derive various notions of a `convergence condition with modulus' which provide quantitative information on this condition in different ways. These techniques then also facilitate the extraction of quantitative information on the convergence results of Nevanlinna and Reich as well as Xu, in particular also in the form of rates of convergence which depend on these moduli for the convergence condition.

Analysis of PDEs,Functional Analysis
Positive Fixed Points for Nonlinear Operators

K Li,J Liang,TJ Xiao

DOI: https://doi.org/10.1016/j.camwa.2005.08.024

IF: 3.218

2005-01-01

Computers & Mathematics with Applications

Abstract:This paper is concerned with the existence and uniqueness of positive fixed points for nonlinear decreasing operators with sublinear perturbation operators in ordered Banach spaces. A new fixed-point theorem, without the assumption of compactness and continuity of operators, is established, and an iterative sequence yielding the fixed point is also given. In addition, an application to nonlinear integral equations is shown.
Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods

Feng-Yi Liao,Lijun Ding,Yang Zheng

2024-08-14

Abstract:Many practical optimization problems lack strong convexity. Fortunately, recent studies have revealed that first-order algorithms also enjoy linear convergences under various weaker regularity conditions. While the relationship among different conditions for convex and smooth functions is well-understood, it is not the case for the nonsmooth setting. In this paper, we go beyond convexity and smoothness, and clarify the connections among common regularity conditions in the class of weakly convex functions, including $\textit{strong convexity}$, $\textit{restricted secant inequality}$, $\textit{subdifferential error bound}$, $\textit{Polyak-Łojasiewicz inequality}$, and $\textit{quadratic growth}$. In addition, using these regularity conditions, we present a simple and modular proof for the linear convergence of the proximal point method (PPM) for convex and weakly convex optimization problems. The linear convergence also holds when the subproblems of PPM are solved inexactly with a proper control of inexactness.

Optimization and Control,Systems and Control

A Regularization Algorithm for Zero Points of Accretive Operators

Rates of convergence for iterative solutions of equations involving set-valued accretive operators

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Strong Convergence of a Parallel Iterative Algorithm in a Reflexive Banach Space

A novel algorithm with an inertial technique for fixed points of nonexpansive mappings and zeros of accretive operators in Banach spaces

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Variational-like inclusion problems involving A-maximal m-relaxed η-accretive mappings in the sense of s.i.p. and fixed point problems

A Unified Convergence Theory for Newton-Type Methods for Zeros of Nonlinear Operators in Banach Spaces

Relative Regularity Conditions and Linear Regularity Properties for Split Feasibility Problems in Normed Linear Spaces

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Convergence Rate of the Relaxed CQ Algorithm under Hölderian Type Error Bound Property

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

Rates of Convergence and Metastability for Chidume's Algorithm for the Approximation of Zeros of Accretive Operators in Banach Spaces

Porosity of perturbed optimization problems in Banach spaces

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

A UNIFIED AND TIGHT LINEAR CONVERGENCE ANALYSIS OF THE RELAXED PROXIMAL POINT ALGORITHM

Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

On computational properties of Cauchy problems generated by accretive operators

Positive Fixed Points for Nonlinear Operators

Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods