Abstract:Sparse optimization has seen its advances in recent decades. For scenarios where the true sparsity is unknown, regularization turns out to be a promising solution. Two popular non-convex regularizations are the so-called $L_0$ norm and $L_q$ norm with $q\in(0,1)$, giving rise to extensive research on their induced optimization. However, the majority of these work centered around the main function that is twice continuously differentiable and the best convergence rate for an algorithm solving the optimization with $q\in(0,1)$ is superlinear. This paper explores the $L_q$ norm regularized optimization in a unified way for any $q\in[0,1)$, where the main function has a semismooth gradient. In particular, we establish the first-order and the second-order optimality conditions under mild assumptions and then integrate the proximal operator and semismooth Newton method to develop a proximal semismooth Newton pursuit algorithm. Under the second sufficient condition, the whole sequence generated by the algorithm converges to a unique local minimizer. Moreover, the convergence is superlinear and quadratic if the gradient of the main function is semismooth and strongly semismooth at the local minimizer, respectively. Hence, this paper accomplishes the quadratic rate for an algorithm designed to solve the $L_q$ norm regularization problem for any $q\in(0,1)$. Finally, some numerical experiments have showcased its nice performance when compared with several existing solvers.

Correction To: Kurdyka–Łojasiewicz Property of Zero-Norm Composite Functions

Porosity of perturbed optimization problems in Banach spaces

Error bound and exact penalty method for optimization problems with nonnegative orthogonal constraint

An Inexact Preconditioned Zeroth-order Proximal Method for Composite Optimization

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

On the smoothing of the norm objective penalty function for two-cardinality sparse constrained optimization problems

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

An Exact Penalty Approach for Optimization with Nonnegative Orthogonality Constraints

Weak Sharp Minima for Convex Infinite Optimization Problems in Normed Linear Spaces

Kurdyka-Łojasiewicz exponent via Hadamard parametrization

Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods

Penalty Methods for a Class of Non-Lipschitz Optimization Problems

Perturbation analysis of a class of composite optimization problems

Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems

Simple Zero Property of Some Holomorphic Functions on the Moduli Space of Tori

A Penalty-Free Infeasible Approach for a Class of Nonsmooth Optimization Problems Over the Stiefel Manifold

Penalty Decomposition Methods for $L0$-Norm Minimization

Revisiting $L_q(0\leq q<1)$ Norm Regularized Optimization

A Note on Complexity for Two Classes of Structured Non-Smooth Non-Convex Compositional Optimization

A Constrained Optimization Approach for Lcp