Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

Improved convergence rates for the Difference-of-Convex algorithm

On the Rate of Convergence of the Difference-of-Convex Algorithm (DCA)

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

Higher-order tensor methods for minimizing difference of convex functions

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

The Difference of Convex Algorithm on Hadamard Manifolds

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

Stable and Total Fenchel Duality for DC Optimization Problems in Locally Convex Spaces.

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Convergence of the Chambolle-Pock Algorithm in the Absence of Monotonicity

Convergence Rate Bounds for the Mirror Descent Method: IQCs, Popov Criterion and Bregman Divergence

Convergence Revisit on Generalized Symmetric ADMM

A NOTE ON THE CONVERGENCE OF THE DFP ALGORITHM ON QUADRATIC UNIFORMLY CONVEX FUNCTIONS

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

A refined convergence analysis of pDCA$_e$ with applications to simultaneous sparse recovery and outlier detection

Convergence for nonconvex ADMM, with applications to CT imaging

Improved Algorithms for Convex-Concave Minimax Optimization

Stochastic Difference-of-Convex Algorithms for Solving nonconvex optimization problems

A convergence analysis of the method of codifferential descent

Convergence of Descent Methods under Kurdyka-Łojasiewicz Properties