Abstract:In this paper we consider minimization of a difference-of-convex (DC) function with and without linear constraints. We first study a smooth approximation of a generic DC function, termed difference-of-Moreau-envelopes (DME) smoothing, where both components of the DC function are replaced by their respective Moreau envelopes. The resulting smooth approximation is shown to be Lipschitz differentiable, capture stationary points, local, and global minima of the original DC function, and enjoy some growth conditions, such as level-boundedness and coercivity, for broad classes of DC functions. We then develop four algorithms for solving DC programs with and without linear constraints based on the DME smoothing. In particular, for a smoothed DC program without linear constraints, we show that the classic gradient descent method as well as an inexact variant can obtain a stationary solution in the limit with a convergence rate of $\mathcal{O}(K^{-1/2})$, where $K$ is the number of proximal evaluations of both components. Furthermore, when the DC program is explicitly constrained in an affine subspace, we combine the smoothing technique with the augmented Lagrangian function and derive two variants of the augmented Lagrangian method (ALM), named LCDC-ALM and composite LCDC-ALM, focusing on different structures of the DC objective function. We show that both algorithms find an $\epsilon$-approximate stationary solution of the original DC program in $\mathcal{O}(\epsilon^{-2})$ iterations. Comparing to existing methods designed for linearly constrained weakly convex minimization, the proposed ALM-based algorithms can be applied to a broader class of problems, where the objective contains a nonsmooth concave component. Finally, numerical experiments are presented to demonstrate the performance of the proposed algorithms.

ALGORITHM FOR COMPLEX NONCONVEX NONDIFFERENTIABL E FUNCTIONS

Optimization Condition and Algorithm of Optimization with Convertible Nonconvex Function

A NONMOTOTONE ALGORITHM FOR MINIMIZING NONSMOOTH COMPOSITE FUNCTIONS

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

Stable and Total Fenchel Duality for Convex Optimization Problems in Locally Convex Spaces

Variational Theory and Algorithms for a Class of Asymptotically Approachable Nonconvex Problems

Convergence of a class of algorithms with the level-set subdifferential error bound

A Gradient Complexity Analysis for Minimizing the Sum of Strongly Convex Functions with Varying Condition Numbers

Hypodifferentials of nonsmooth convex functions and their applications to nonsmooth convex optimization

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

An entropy based central cutting plane algorithm for convex min-max semi-infinite programming problems

A Direct Searching Method for Nonlinear Optimizing Problems and Its Convergence Proof

A Convexification Method for a Class of Global Optimization Problems with Applications to Reliability Optimization

Nonsmooth Steepest Descent Method by Proximal Subdifferentials in Hilbert Spaces

A DECOMPOSITION METHOD FOR CONVEX MINIMIZATION PROBLEMS AND ITS APPLICATION

Convexification, Concavification and Monotonization in Global Optimization

Abstract convex approximations of nonsmooth functions

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

Generalized Polyhedral DC Optimization Problems

Algorithms for Difference-of-Convex (DC) Programs Based on Difference-of-Moreau-Envelopes Smoothing

A New Filled Function Method for the Non-convex Global Optimization