Abstract:We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute), some of which are further composed with linear maps. This kind of problems arises naturally in various applications when different regularizers are introduced for inducing simultaneous structures in the solutions. Solving these problems, however, can be challenging because of the coupled nonsmooth functions: the corresponding proximal mapping can be hard to compute so that standard first-order methods such as the proximal gradient algorithm cannot be applied efficiently. In this paper, we propose a successive difference-of-convex approximation method for solving this kind of problems. In this algorithm, we approximate the nonsmooth functions by their Moreau envelopes in each iteration. Making use of the simple observation that Moreau envelopes of nonnegative proper closed functions are continuous difference-of-convex functions, we can then approximately minimize the approximation function by first-order methods with suitable majorization techniques. These first-order methods can be implemented efficiently thanks to the fact that the proximal mapping of each nonsmooth function is easy to compute. Under suitable assumptions, we prove that the sequence generated by our method is bounded and any accumulation point is a stationary point of the objective. We also discuss how our method can be applied to concrete applications such as nonconvex fused regularized optimization problems and simultaneously structured matrix optimization problems, and illustrate the performance numerically for these two specific applications.

A Bundle Proximal Method for Solving General Mixed Variational Inequalities

A Nonconvex Proximal Bundle Method for Nonsmooth Constrained Optimization

Proximal bundle methods for hybrid weakly convex composite optimization problems

A General Inertial Proximal Point Algorithm for Mixed Variational Inequality Problem.

Primal-dual proximal bundle and conditional gradient methods for convex problems

Universal subgradient and proximal bundle methods for convex and strongly convex hybrid composite optimization

A Proximal-Gradient Method for Constrained Optimization

A general inertial proximal point method for mixed variational inequality problem

A Bregman proximal subgradient algorithm for nonconvex and nonsmooth fractional optimization problems

A proximal bundle variant with optimal iteration-complexity for a large range of prox stepsizes

A single cut proximal bundle method for stochastic convex composite optimization

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

A Cutting Plane and Level Stabilization Bundle Method with Inexact Data for Minimizing Nonsmooth Nonconvex Functions

A Single-Loop Stochastic Proximal Quasi-Newton Method for Large-Scale Nonsmooth Convex Optimization

On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping

The Riemannian Convex Bundle Method

A splitting primal-dual proximity algorithm for solving composite optimization problems

Linear Convergence of the Derivative-Free Proximal Bundle Method on Convex Nonsmooth Functions, with Application to the Derivative-Free -Algorithm

Proximal methods for structured nonsmooth optimization over Riemannian submanifolds

Proximal Subgradient Algorithm for a Class of Nonconvex Bilevel Equilibrium Problems

Complexity and numerical experiments of a new adaptive generic proximal bundle method