Abstract:We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute), some of which are further composed with linear maps. This kind of problems arises naturally in various applications when different regularizers are introduced for inducing simultaneous structures in the solutions. Solving these problems, however, can be challenging because of the coupled nonsmooth functions: the corresponding proximal mapping can be hard to compute so that standard first-order methods such as the proximal gradient algorithm cannot be applied efficiently. In this paper, we propose a successive difference-of-convex approximation method for solving this kind of problems. In this algorithm, we approximate the nonsmooth functions by their Moreau envelopes in each iteration. Making use of the simple observation that Moreau envelopes of nonnegative proper closed functions are continuous difference-of-convex functions, we can then approximately minimize the approximation function by first-order methods with suitable majorization techniques. These first-order methods can be implemented efficiently thanks to the fact that the proximal mapping of each nonsmooth function is easy to compute. Under suitable assumptions, we prove that the sequence generated by our method is bounded and any accumulation point is a stationary point of the objective. We also discuss how our method can be applied to concrete applications such as nonconvex fused regularized optimization problems and simultaneously structured matrix optimization problems, and illustrate the performance numerically for these two specific applications.

Proximal-Like Algorithm Using the Quasi D-Function for Convex Second-Order Cone Programming

A Symplectic Discretization Based Proximal Point Algorithm for Convex Minimization

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Conic approximation to nonconvex quadratic programming with convex quadratic constraints

An inexact proximal point method with quasi-distance for quasi-convex multiobjective optimization

N ov 2 01 6 A Proximal Stochastic Quasi-Newton Algorithm

A globally convergent difference-of-convex algorithmic framework and application to log-determinant optimization problems

Quadratic Optimization over A Polyhedral Cone

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A Proximal-Gradient Method for Constrained Optimization

Linear Convergence of the Derivative-Free Proximal Bundle Method on Convex Nonsmooth Functions, with Application to the Derivative-Free -Algorithm

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

Proximal Algorithms for a class of abstract convex functions

Proximal Dogleg Opportunistic Majorization for Nonconvex and Nonsmooth Optimization

A Two-Step Proximal Point Algorithm for Nonconvex Equilibrium Problems with Applications to Fractional Programming

Proximal-point-like algorithms for abstract convex minimisation problems

D-SOP: Distributed Second Order Proximal Method for Convex Composite Optimization.

Proximity Query Based on Second Order Cone Programming Using Convex Superquadrics: a Static Collision Detection Algorithm for Narrow-Phase

A Quadratically Convergent Sequential Programming Method for Second-Order Cone Programs Capable of Warm Starts

Adaptive computable approximation to cones of nonnegative quadratic functions

Convergence Rate Analysis of a Dykstra-Type Projection Algorithm