Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

Successive convex approximations to cardinality-constrained convex programs: a piecewise-linear DC approach

A SUCCESSIVE CONVEX APPROXIMATION APPROACH FOR SPARSE SOLUTIONS OF CONVEX PROGRAMS

Optimality Conditions for Cardinality-Constrained Programs and a SCA Method.

Cardinality-constrained Programs with Nonnegative Variables and an SCA Method

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Stable and Total Fenchel Duality for DC Optimization Problems in Locally Convex Spaces.

Constraint Qualification, the Strong CHIP, and Best Approximation with Convex Constraints in Banach Spaces.

Extended Farkas's lemmas and strong lagrange dualities for DC infinite programming

Cardinality Constrained Portfolio Selection Problem: A Completely Positive Programming Approach

Cardinality-Constrained Continuous Knapsack Problem with Concave Piecewise-Linear Utilities

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

Solving a Class of Nonconvex Quadratic Programs by Inertial DC Algorithms

A D.C. approximation approach for optimization with probabilistic constraints based on Chen–Harker–Kanzow–Smale smooth plus function

Asymptotic Closure Condition and Fenchel Duality for DC Optimization Problems in Locally Convex Spaces

Nonconvex Quadratically Constrained Quadratic Programming: Best D.C. Decompositions and Their SDP Representations.

Sequential Convex Approximations to Joint Chance Constrained Programs: A Monte Carlo Approach.

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

Compact Disjunctive Approximations to Nonconvex Quadratically Constrained Programs

A Canonical Dual Approach for Solving Linearly Constrained Quadratic Programs

An Inexact Proximal Linearized DC Algorithm with Provably Terminating Inner Loop