Abstract:Recently, variable selection and sparse reconstruction are solved by finding an optimal solution of a minimization model, where the objective function is the sum of a data-fitting term in l(2) norm and a regularization term in l(p) norm (0 < p < 1). Since it is a nonconvex model, most algorithms for solving the problem can provide only an approximate local optimal solution, where nonzero entries in the solution cannot be identified theoretically. In this paper, we establish lower bounds for the absolute value of nonzero entries in every local optimal solution of the model, which can be used to indentify zero entries precisely in any numerical solution. Therefore, we have developed a lower bound theorem to classify zero and nonzero entries in every local solution. These lower boundsclearly show the relationship between the sparsity of the solution and the choice of the regularization parameter and norm so that our theorem can be used for selecting desired model parameters and norms. Furthermore, we also develop error bounds for verifying the accuracy of numerical solutions of the l(2)-(p) minimization model. To demonstrate applications of our theory, we propose a hybrid orthogonal matching pursuit-smoothing gradient (OMP-SG) method for solving the nonconvex, non-Lipschitz continuous l(2)-l(p) minimization problem. Computational results show the effectiveness of the lower bounds for identifying nonzero entries in numerical solutions and the OMP-SG method for finding a high quality numerical solution.

A Note on the Sensitivity of the Solution of the Weighted Linear Least Squares Problem

A Note on the Scaled Total Least Squares Problem

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

A SENSITIVITY ANALYSIS OF INVERSE SINGULAR VALUE PROBLEMS

On the average sensitivity of the weighted sum function

Condition Numbers and Perturbation of the Weighted Moore-Penrose Inverse and Weighted Linear Least Squares Problem.

Perturbation bounds for constrained and weighted least squares problems

Monotonic Properties of the Least Squares Mean

Relative Errors Versus Residuals of Approximate Solutions of Weighted Least Squares Problems in Hilbert Space

A New Preconditioner for Solving Weighted Toeplitz Least Squares Problems

A compromise criterion for weighted least squares estimates

A Note on Wilkinson's Iterative Refinement of Solution with Automatic Step-Size Control

Effective Condition Number for Weighted Linear Least Squares Problems and Applications to the Trefftz Method

Lower Bound Theory of Nonzero Entries in Solutions of $\Ell_2$-$\Ell_p$ Minimization

Weighted least squares solutions to general coupled Sylvester matrix equations

A note on the generalised Hessian of the least squares associated with systems of linear inequalities

Iterative algorithm for minimal norm least squares solution to general linear matrix equations

A Note on Solving EP Inconsistent Linear Systems

A new interpretation of the weighted pseudoinverse and its applications

A note on Oishi's lower bound for the smallest singular value of linearized Galerkin equations

On an Iterative Method for Solving the Least Squares Problem of Rank-Deficient Systems