Abstract:Inverse imaging covers a wide range of imaging applications, including super-resolution, deblurring, and compressive sensing. We propose a novel scheme to solve such problems by combining duality and the alternating direction method of multipliers (ADMM). In addition to a conventional ADMM process, we introduce a second one that solves the dual problem to find the estimated nontrivial lower bound of the objective function, and the related iteration results are used in turn to guide the primal iterations. We call this D-ADMM, and show that it converges to the global minimum when the regularization function is convex and the optimization problem has at least one optimizer. Furthermore, we show how the scheme can give rise to two specific algorithms, called D-ADMM-L2 and D-ADMM-TV, by having different regularization functions. We compare D-ADMM-TV with other methods on image super-resolution and demonstrate comparable or occasionally slightly better quality results. This paves the way of incorporating advanced operators and strategies designed for basic ADMM into the D-ADMM method as well to further improve the performances of those methods.

Alternating Direction Method of Multipliers for Linear Inverse Problems

Relaxing Alternating Direction Method of Multipliers (ADMM) for Linear Inverse Problems

Dual Alternating Direction Method of Multipliers for Inverse Imaging

On convergence rates of proximal alternating direction method of multipliers

An alternating direction method of multipliers for inverse lithography problem

Alternating Direction Method of Multipliers for a Class of Nonconvex Bilinear Optimization: Convergence Analysis and Applications.

An Inertial Proximal Alternating Direction Method of Multipliers for Nonconvex Optimization.

An Inexact Alternating Direction Method of Multipliers with Relative Error Criteria

A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization

A Nonconvex ADMM for a Class of Sparse Inverse Semidefinite Quadratic Programming Problems

Alternating Direction Method of Multipliers with Difference of Convex Functions.

An inertial alternating direction method of multipliers for solving a two-block separable convex minimization problem

An Alternating Direction Method of Multipliers for MCP-penalized Regression with High-dimensional Data

A Stochastic Alternating Direction Method of Multipliers for Non-smooth and Non-convex Optimization

Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

An Empirical Study of ADMM for Nonconvex Problems

A parallel alternating direction method with application to compound l1-regularized imaging inverse problems.

A Fast Symmetric Alternating Direction Method of Multipliers

Alternating Direction Method of Multipliers Based on $\ell_{2,0}$-norm for Multiple Measurement Vector Problem

A Symmetric Alternating Direction Method of Multipliers for Separable Nonconvex Minimization Problems

An Inertial Proximal Partially Symmetric ADMM-based Algorithm for Linearly Constrained Multi-Block Nonconvex Optimization Problems with Applications.