Abstract:Proximal–gradient methods are widely employed tools in imaging that can be accelerated by adopting variable metrics and/or extrapolation steps. One crucial issue is the inexact computation of the proximal operator, often implemented through a nested primal–dual solver, which represents the main computational bottleneck whenever an increasing accuracy in the computation is required. In this paper, we propose a nested primal–dual method for the efficient solution of regularized convex optimization problems. Our proposed method approximates a variable metric proximal–gradient step with extrapolation by performing a prefixed number of primal–dual iterates, while adjusting the steplength parameter through an appropriate backtracking procedure. Choosing a prefixed number of inner iterations allows the algorithm to keep the computational cost per iteration low. We prove the convergence of the iterates sequence towards a solution of the problem, under a relaxed monotonicity assumption on the scaling matrices and a shrinking condition on the extrapolation parameters. Furthermore, we investigate the numerical performance of our proposed method by equipping it with a scaling matrix inspired by the Iterated Tikhonov method. The numerical results show that the combination of such scaling matrices and Nesterov-like extrapolation parameters yields an effective acceleration towards the solution of the problem.

On Steepest-Descent-Kaczmarz methods for regularizing systems of nonlinear ill-posed equations

Modified iterated Tikhonov methods for solving systems of nonlinear ill-posed equations

An Accelerated Kaczmarz Type Method for Nonlinear Inverse Problems in Banach Spaces with Uniformly Convex Penalty

An Analysis of a Multi-Level Projected Steepest Descent Iteration for Nonlinear Inverse Problems in Banach Spaces Subject to Stability Constraints

A Bregman-Kaczmarz method for nonlinear systems of equations

A Regularization Method for Solving Nonlinear Inverse Problems

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

On the Convergence of A Data-Driven Regularized Stochastic Gradient Descent for Nonlinear Ill-Posed Problems

On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

Addendum: On stochastic Kaczmarz type methods for solving large scale systems of ill-posed equations (2022 Inverse Problems 38 025003)

Single projection Kaczmarz extended algorithms

A data-driven iteratively regularized Landweber iteration

A Fast Averaged Kaczmarz Iteration with Convex Penalty for Inverse Problems in Hilbert Spaces

Steepest Geometric Descent for Regularized Quasiconvex Functions

Nonlinear Kaczmarz algorithms and their convergence

A semismooth conjugate gradients method – theoretical analysis

A nested primal–dual iterated Tikhonov method for regularized convex optimization

Preasymptotic convergence of randomized Kaczmarz method

A New Kaczmarz-Type Method And Its Acceleration For Nonlinear Ill-Posed Problems