Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programming with Application to Imaging Data

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

Inertial Proximal Difference-of-Convex Algorithm with Convergent Bregman Plug-and-Play for Nonconvex Imaging

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

A splitting primal-dual proximity algorithm for solving composite optimization problems

A proximal splitting algorithm for generalized DC programming with applications in signal recovery

A Nonlinear Bregman Primal-Dual Framework for Optimizing Nonconvex Infimal Convolutions

A HYBRID ALTERNATING MINIMIZATION ALGORITHM FOR STRUCTURED CONVEX OPTIMIZATION PROBLEMS WITH APPLICATION IN POISSONIAN IMAGE PROCESSING

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

An Inexact Bregman Proximal Difference-of-Convex Algorithm with Two Types of Relative Stopping Criteria

An Inexact Proximal Linearized DC Algorithm with Provably Terminating Inner Loop

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

Efficiency of Coordinate Descent Methods For Structured Nonconvex Optimization

Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functions

Convergence for nonconvex ADMM, with applications to CT imaging

An extended primal-dual algorithm framework for nonconvex problems: Application to image reconstruction in spectral CT

An Extended Primal-Dual Algorithm Framework for Nonconvex Problems with Application to Nonlinear Imaging

Difference of Submodular Minimization via DC Programming