Abstract:Recently, variable selection and sparse reconstruction are solved by finding an optimal solution of a minimization model, where the objective function is the sum of a data-fitting term in l(2) norm and a regularization term in l(p) norm (0 < p < 1). Since it is a nonconvex model, most algorithms for solving the problem can provide only an approximate local optimal solution, where nonzero entries in the solution cannot be identified theoretically. In this paper, we establish lower bounds for the absolute value of nonzero entries in every local optimal solution of the model, which can be used to indentify zero entries precisely in any numerical solution. Therefore, we have developed a lower bound theorem to classify zero and nonzero entries in every local solution. These lower boundsclearly show the relationship between the sparsity of the solution and the choice of the regularization parameter and norm so that our theorem can be used for selecting desired model parameters and norms. Furthermore, we also develop error bounds for verifying the accuracy of numerical solutions of the l(2)-(p) minimization model. To demonstrate applications of our theory, we propose a hybrid orthogonal matching pursuit-smoothing gradient (OMP-SG) method for solving the nonconvex, non-Lipschitz continuous l(2)-l(p) minimization problem. Computational results show the effectiveness of the lower bounds for identifying nonzero entries in numerical solutions and the OMP-SG method for finding a high quality numerical solution.

Maximum entropy method for nonlinear lp problem

A Monotonous Method Based on Maximal Entropy Function in Nonlinear Programming

Methods of Moment and Maximum Entropy for Solving Nonlinear Expectation

New maximum entropy-based algorithm for structural design optimization

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Maximum Entropy Function Method for Nonconvex Optimization in Compressed Sensing

L-P-Estimates for General Nonlinear Elliptic Equations

An Effective Algorithm for Nonlinear Constraint Max-min Problems

Lower Bound Theory of Nonzero Entries in Solutions of $\Ell_2$-$\Ell_p$ Minimization

L2-theory of Linear Degenerate SPDEs and Lp (

Global optimization algorithm for solving linear multiplicative programming problems

On Global Solution for a Class of p(x)-Laplacian Equations with Logarithmic Nonlinearity

Linearly Constrained Global Optimization Via Piecewise-Linear Approximation

Maximum principles and monotonicity of solutions to fractional p -Laplacian operator with the Hardy potential

On $p(x)$-Laplacian equations in $\mathbb{R}^{N}$ with nonlinearity sublinear at zero

A numerical solution approach for non-smooth optimal control problems based on the Pontryagin maximum principle

Minimization of Eigenvalues of One-Dimensional P-Laplacian with Integrable Potentials

Multiple solutions for inequality Dirichlet problems by the p(x)-Laplacian

Beyond first-order methods for non-convex non-concave min-max optimization

Optimality Conditions for Optimal Control of Non-Well-posed P-Laplacian Elliptic Equations

A new linearization technique for minimax linear fractional programming