Abstract:Sparse optimization has seen its advances in recent decades. For scenarios where the true sparsity is unknown, regularization turns out to be a promising solution. Two popular non-convex regularizations are the so-called $L_0$ norm and $L_q$ norm with $q\in(0,1)$, giving rise to extensive research on their induced optimization. However, the majority of these work centered around the main function that is twice continuously differentiable and the best convergence rate for an algorithm solving the optimization with $q\in(0,1)$ is superlinear. This paper explores the $L_q$ norm regularized optimization in a unified way for any $q\in[0,1)$, where the main function has a semismooth gradient. In particular, we establish the first-order and the second-order optimality conditions under mild assumptions and then integrate the proximal operator and semismooth Newton method to develop a proximal semismooth Newton pursuit algorithm. Under the second sufficient condition, the whole sequence generated by the algorithm converges to a unique local minimizer. Moreover, the convergence is superlinear and quadratic if the gradient of the main function is semismooth and strongly semismooth at the local minimizer, respectively. Hence, this paper accomplishes the quadratic rate for an algorithm designed to solve the $L_q$ norm regularization problem for any $q\in(0,1)$. Finally, some numerical experiments have showcased its nice performance when compared with several existing solvers.

L_p-norm Regularization Algorithms for Optimization over Permutation Matrices

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Success probability of the $L_0$-regularized box-constrained Babai point and column permutation strategies

l1-norm regularized l1-norm best-fit lines

Group Sparse Optimization Via Lp, Q Regularization.

Restricted -Isometry Properties of Nonconvex Matrix Recovery

Revisiting $L_q(0\leq q<1)$ Norm Regularized Optimization

Penalty Decomposition Methods for $L0$-Norm Minimization

Group sparse optimization via l

Plug‐and‐play algorithms for convex non‐convex regularization: Convergence analysis and applications

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

Problem : Regularized Optimization for Inducing Block-diagonal Matrices

Online Optimization for Large-Scale Max-Norm Regularization

Modified Lp-Norm Regularization Minimization for Sparse Signal Recovery

On Partial Smoothness, Activity Identification and Faster Algorithms of L1 over L2 Minimization

Neural Network for a Class of Sparse Optimization with L0-regularization.

Nonconvex Mixed Matrix Minimization

On Partly Smoothness, Activity Identification and Faster Algorithms of L 1 over L 2 Minimization

L-P Norm Localized Multiple Kernel Learning Via Semi-Definite Programming