Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

An inexact proximal linearized DC algorithm with provably terminating inner loop

An Inexact Proximal Linearized DC Algorithm with Provably Terminating Inner Loop

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

A proximal splitting algorithm for generalized DC programming with applications in signal recovery

Inexact proximal DC Newton-type method for nonconvex composite functions

An Inexact Bregman Proximal Difference-of-Convex Algorithm with Two Types of Relative Stopping Criteria

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

A refined convergence analysis of pDCA$_e$ with applications to simultaneous sparse recovery and outlier detection

An inexact LPA for DC composite optimization and application to matrix completions with outliers

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Efficient DC Algorithm for Constrained Sparse Optimization

Inertial Proximal Difference-of-Convex Algorithm with Convergent Bregman Plug-and-Play for Nonconvex Imaging

Algorithms for DC Programming via Polyhedral Approximations of Convex Functions

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

Extended Farkas's lemmas and strong lagrange dualities for DC infinite programming

Stable and Total Fenchel Duality for DC Optimization Problems in Locally Convex Spaces.

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programming with Application to Imaging Data