Abstract:Proximal–gradient methods are widely employed tools in imaging that can be accelerated by adopting variable metrics and/or extrapolation steps. One crucial issue is the inexact computation of the proximal operator, often implemented through a nested primal–dual solver, which represents the main computational bottleneck whenever an increasing accuracy in the computation is required. In this paper, we propose a nested primal–dual method for the efficient solution of regularized convex optimization problems. Our proposed method approximates a variable metric proximal–gradient step with extrapolation by performing a prefixed number of primal–dual iterates, while adjusting the steplength parameter through an appropriate backtracking procedure. Choosing a prefixed number of inner iterations allows the algorithm to keep the computational cost per iteration low. We prove the convergence of the iterates sequence towards a solution of the problem, under a relaxed monotonicity assumption on the scaling matrices and a shrinking condition on the extrapolation parameters. Furthermore, we investigate the numerical performance of our proposed method by equipping it with a scaling matrix inspired by the Iterated Tikhonov method. The numerical results show that the combination of such scaling matrices and Nesterov-like extrapolation parameters yields an effective acceleration towards the solution of the problem.

A Global Minimization Algorithm for Tikhonov Functionals with Sparsity Constraints

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

Tensor Conjugate Gradient Methods with Automatically Determination of Regularization Parameters for Ill-Posed Problems with t-Product

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

On SCD Semismooth$^*$ Newton methods for the efficient minimization of Tikhonov functionals with non-smooth and non-convex penalties

Nonstationary iterated frozen Tikhonov regularization with uniformly convex penalty terms for solving inverse problems

A dual based semismooth Newton-type algorithm for solving large-scale sparse Tikhonov regularization problems

A proximal-gradient inertial algorithm with Tikhonov regularization: strong convergence to the minimal norm solution

Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

A Fast Two-Point Gradient Method for Solving Non-Smooth Nonlinear Ill-Posed Problems

Minimization Over the Nonconvex Sparsity Constraint Using A Hybrid First-order method

A nested primal–dual iterated Tikhonov method for regularized convex optimization

On the convergence of an inertial proximal algorithm with a Tikhonov regularization term

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

A Gradient Descent Based Algorithm for ℓ Minimization.

A primal-dual hybrid gradient method for non-linear operators with applications to MRI

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

Convergence and adaptive discretization of the IRGNM Tikhonov and the IRGNM Ivanov method under a tangential cone condition in Banach space

A Nesterov type algorithm with double Tikhonov regularization: fast convergence of the function values and strong convergence to the minimal norm solution