Abstract:We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute), some of which are further composed with linear maps. This kind of problems arises naturally in various applications when different regularizers are introduced for inducing simultaneous structures in the solutions. Solving these problems, however, can be challenging because of the coupled nonsmooth functions: the corresponding proximal mapping can be hard to compute so that standard first-order methods such as the proximal gradient algorithm cannot be applied efficiently. In this paper, we propose a successive difference-of-convex approximation method for solving this kind of problems. In this algorithm, we approximate the nonsmooth functions by their Moreau envelopes in each iteration. Making use of the simple observation that Moreau envelopes of nonnegative proper closed functions are continuous difference-of-convex functions, we can then approximately minimize the approximation function by first-order methods with suitable majorization techniques. These first-order methods can be implemented efficiently thanks to the fact that the proximal mapping of each nonsmooth function is easy to compute. Under suitable assumptions, we prove that the sequence generated by our method is bounded and any accumulation point is a stationary point of the objective. We also discuss how our method can be applied to concrete applications such as nonconvex fused regularized optimization problems and simultaneously structured matrix optimization problems, and illustrate the performance numerically for these two specific applications.

A Bregman proximal subgradient algorithm for nonconvex and nonsmooth fractional optimization problems

A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems

Proximal methods for structured nonsmooth optimization over Riemannian submanifolds

An equivalent reformulation and multi-proximity gradient algorithms for a class of nonsmooth fractional programming

Globally Optimal Solutions to a Class of Fractional Optimization Problems Based on Proximal Gradient Algorithm

Bregman Proximal Gradient Algorithm with Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems

A Bregman Stochastic Method for Nonconvex Nonsmooth Problem Beyond Global Lipschitz Gradient Continuity.

A Unified Analysis for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions.

Proximal Gradient-Type Algorithms for a Class of Bilevel Programming Problems

Proximal Subgradient Algorithm for a Class of Nonconvex Bilevel Equilibrium Problems

Approximate Bregman Proximal Gradient Algorithm for Relatively Smooth Nonconvex Optimization

A Two-Step Proximal Point Algorithm for Nonconvex Equilibrium Problems with Applications to Fractional Programming

Adaptive Fixed-Time Proximal Gradient Method for Non-Smooth Optimization: the Fractional Approach

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

An Alternating Structure-Adapted Bregman Proximal Gradient Descent Algorithm for Constrained Nonconvex Nonsmooth Optimization Problems and Its Inertial Variant.

Semi-Proximal Point Method for Nonsmooth Convex-Concave Minimax Optimization

Accelerated Bregman Proximal Gradient Methods for Relatively Smooth Convex Optimization

Smoothing randomized block-coordinate proximal gradient algorithms for nonsmooth nonconvex composite optimization

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

A subgradient projection method for quasiconvex multiobjetive optimization

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization.