Abstract:In this paper we consider minimization of a difference-of-convex (DC) function with and without linear constraints. We first study a smooth approximation of a generic DC function, termed difference-of-Moreau-envelopes (DME) smoothing, where both components of the DC function are replaced by their respective Moreau envelopes. The resulting smooth approximation is shown to be Lipschitz differentiable, capture stationary points, local, and global minima of the original DC function, and enjoy some growth conditions, such as level-boundedness and coercivity, for broad classes of DC functions. We then develop four algorithms for solving DC programs with and without linear constraints based on the DME smoothing. In particular, for a smoothed DC program without linear constraints, we show that the classic gradient descent method as well as an inexact variant can obtain a stationary solution in the limit with a convergence rate of $\mathcal{O}(K^{-1/2})$, where $K$ is the number of proximal evaluations of both components. Furthermore, when the DC program is explicitly constrained in an affine subspace, we combine the smoothing technique with the augmented Lagrangian function and derive two variants of the augmented Lagrangian method (ALM), named LCDC-ALM and composite LCDC-ALM, focusing on different structures of the DC objective function. We show that both algorithms find an $\epsilon$-approximate stationary solution of the original DC program in $\mathcal{O}(\epsilon^{-2})$ iterations. Comparing to existing methods designed for linearly constrained weakly convex minimization, the proposed ALM-based algorithms can be applied to a broader class of problems, where the objective contains a nonsmooth concave component. Finally, numerical experiments are presented to demonstrate the performance of the proposed algorithms.

Lagrange duality on DC evenly convex optimization problems via a generalized conjugation scheme

Stable and Total Fenchel Duality for DC Optimization Problems in Locally Convex Spaces.

Extended Farkas's lemmas and strong lagrange dualities for DC infinite programming

Asymptotic Closure Condition and Fenchel Duality for DC Optimization Problems in Locally Convex Spaces

Stable and Total Fenchel Duality for Convex Optimization Problems in Locally Convex Spaces

Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

STABLE LAGRANGE DUALITIES FOR ROBUST CONICAL PROGRAMMING

Constraint Qualifications for Extended Farkas'S Lemmas and Lagrangian Dualities in Convex Infinite Programming

Convergence analysis of primal-dual augmented Lagrangian methods and duality theory

Towards Strong Duality in Integer Programming

Frank-Wolfe meets Shapley-Folkman: a systematic approach for solving nonconvex separable problems with linear constraints

An approach to duality via image space analysis and applications to linear vector optimization problems

Lagrangian Reformulation for Nonconvex Optimization: Tailoring Problems to Specialized Solvers

Lagrangian Duality for Constrained Deep Learning

Lossless Convexification and Duality

A Duality Theory for Non-convex Problems in the Calculus of Variations

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

Dualities in Convex Algebraic Geometry

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

Doubly relaxed forward-Douglas--Rachford splitting for the sum of two nonconvex and a DC function

Using duality to solve generalized fractional programming problems