Abstract:We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute), some of which are further composed with linear maps. This kind of problems arises naturally in various applications when different regularizers are introduced for inducing simultaneous structures in the solutions. Solving these problems, however, can be challenging because of the coupled nonsmooth functions: the corresponding proximal mapping can be hard to compute so that standard first-order methods such as the proximal gradient algorithm cannot be applied efficiently. In this paper, we propose a successive difference-of-convex approximation method for solving this kind of problems. In this algorithm, we approximate the nonsmooth functions by their Moreau envelopes in each iteration. Making use of the simple observation that Moreau envelopes of nonnegative proper closed functions are continuous difference-of-convex functions, we can then approximately minimize the approximation function by first-order methods with suitable majorization techniques. These first-order methods can be implemented efficiently thanks to the fact that the proximal mapping of each nonsmooth function is easy to compute. Under suitable assumptions, we prove that the sequence generated by our method is bounded and any accumulation point is a stationary point of the objective. We also discuss how our method can be applied to concrete applications such as nonconvex fused regularized optimization problems and simultaneously structured matrix optimization problems, and illustrate the performance numerically for these two specific applications.

An ODE-like Nonmonotone Method for Nonsmooth Convex Optimization

A Nonmonotone ODE-based Method for Unconstrained Optimization

A Memory Gradient Method for Non-Smooth Convex Optimization

A Quasi-Newton-Type Nonmonotone ODE Method for Unconstrained Optimization

The Barzilai and Borwein Gradient Method with Nonmonotone Line Search for Nonsmooth Convex Optimization Problems

An ODE-based hybrid method based on the nonmonotone technique

A Modified Scaled Memoryless BFGS Preconditioned Conjugate Gradient Algorithm for Nonsmooth Convex Optimization

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

A Class of Derivative-Free Methods for Large-Scale Nonlinear Monotone Equations

A Perry-Shanno Memoryless Quasi-Newton-type Method for Nondifferentiable Convex Optimization

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

A Class of Alternating Linearization Algorithms for Nonsmooth Convex Optimization

A Regularized Newton Method for Monotone Nonlinear Equations and Its Application

An Approximate Quasi-Newton Bundle-Type Method for Nonsmooth Optimization

Semi-Proximal Point Method for Nonsmooth Convex-Concave Minimax Optimization

An inexact regularized proximal Newton method for nonconvex and nonsmooth optimization

Coderivative-Based Newton Methods with Wolfe Linesearch for Nonsmooth Optimization

Yosida-regularization Based Differential Equation Approach to Generalized Equations with Applications to Nonlinear Convex Programming

An Efficient Three-Term Conjugate Gradient Method for Nonlinear Monotone Equations with Convex Constraints

A Hybrid and Inexact Algorithm for Nonconvex and Nonsmooth Optimization