Abstract:We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute), some of which are further composed with linear maps. This kind of problems arises naturally in various applications when different regularizers are introduced for inducing simultaneous structures in the solutions. Solving these problems, however, can be challenging because of the coupled nonsmooth functions: the corresponding proximal mapping can be hard to compute so that standard first-order methods such as the proximal gradient algorithm cannot be applied efficiently. In this paper, we propose a successive difference-of-convex approximation method for solving this kind of problems. In this algorithm, we approximate the nonsmooth functions by their Moreau envelopes in each iteration. Making use of the simple observation that Moreau envelopes of nonnegative proper closed functions are continuous difference-of-convex functions, we can then approximately minimize the approximation function by first-order methods with suitable majorization techniques. These first-order methods can be implemented efficiently thanks to the fact that the proximal mapping of each nonsmooth function is easy to compute. Under suitable assumptions, we prove that the sequence generated by our method is bounded and any accumulation point is a stationary point of the objective. We also discuss how our method can be applied to concrete applications such as nonconvex fused regularized optimization problems and simultaneously structured matrix optimization problems, and illustrate the performance numerically for these two specific applications.

Subdifferentials and Coderivatives of Efficient Point Multifunctions in Parametric Convex Vector Optimization

Optimality conditions and sensitivity analysis in parametric convex minimax programming

Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization

Optimality and duality in nonsmooth multiobjective fractional programming problem with constraints

Sensitivity Analysis in Parametric Convex Vector Optimization

Superefficiency in Vector Optimization with Nearly Subconvexlike Set-Valued Maps

Optimization Condition and Algorithm of Optimization with Convertible Nonconvex Function

Efficiency Conditions for Nonsmooth Vector Equilibrium Problems with Constraints via Generalized Subdifferentials

A successive difference-of-convex approximation method for a class of nonconvex nonsmooth optimization problems

Codifferentials and Quasidifferentials of the Expectation of Nonsmooth Random Integrands and Two-Stage Stochastic Programming

Formulas for calculating of generalized differentials with respect to a set and their applications

Formulas for Calculating Generalized Differentials with Respect to a Set and Their Applications

Optimality and duality results for E-differentiable multiobjective fractional programming problems under E-convexity

Generalized derivatives of optimal-value functions with parameterized convex programs embedded

A study of convex convex-composite functions via infimal convolution with applications

Regular Subgradients of Marginal Functions with Applications to Calculus and Bilevel Programming

Implicit Multifunction Theorems in Banach Spaces

Global Approximations of Vector Optimization Problems in Terms of Variational Convergence

Non-subdifferentiability optimality and mean value theorems via new relative subdifferentials

Optimality conditions and subdifferential calculus for infinite sums of functions

Smoothness of Subgradient Mappings and Its Applications in Parametric Optimization