Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

A Primal-Dual Fixed-Point Algorithm for Minimization of the Sum of Three Convex Separable Functions

A primal-dual fixed point algorithm for multi-block convex minimization

A Primal–dual Fixed Point Algorithm for Convex Separable Minimization with Applications to Image Restoration

A splitting primal-dual proximity algorithm for solving composite optimization problems

A Primal-Dual Fixed Point Algorithm Based on Proximity Operator for Convex Set Constrained Separable Problem

An Inertial Primal‐dual Fixed Point Algorithm for Composite Optimization Problems

A Stochastic Variance Reduced Primal Dual Fixed Point Method for Linearly Constrained Separable Optimization

Two Modified Schemes for the Primal Dual Fixed Point Method

Efficient Primal–dual Fixed Point Algorithms with Dynamic Stepsize for Composite Convex Optimization Problems

A Modified Primal-Dual Algorithm for Structured Convex Optimization with a Lipschitzian Term

A new primal-dual algorithm for structured convex optimization involving a lipschitzian term

Stochastic Primal Dual Fixed Point Method for Composite Optimization

A HYBRID ALTERNATING MINIMIZATION ALGORITHM FOR STRUCTURED CONVEX OPTIMIZATION PROBLEMS WITH APPLICATION IN POISSONIAN IMAGE PROCESSING

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

Primal Dual Alternating Proximal Gradient Algorithms for Nonsmooth Nonconvex Minimax Problems with Coupled Linear Constraints

Local Linear Convergence Analysis of Primal–Dual Splitting Methods

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

Several Variants of the Primal-Dual Hybrid Gradient Algorithm with Applications

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programming with Application to Imaging Data

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

A New Penalty Dual-Primal Augmented Lagrangian Method and Its Extensions