Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained [Formula: see text] (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained [Formula: see text] (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained [Formula: see text] minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained [Formula: see text] minimization model extends the linearly constrained [Formula: see text] and unconstrained [Formula: see text]-[Formula: see text] models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

The QLY Least-Squares and the QLY Least-Squares Minimal-Norm of Linear Dual Least Squares Problems

On the Null Space Property of L Q-Minimization for 0 < Q ≤ 1 in Compressed Sensing

A metric function for dual quaternion matrices and related least-squares problems

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Solving the QLY Least Squares Problem of Dual Quaternion Matrix Equation Based on STP of Dual Quaternion Matrices

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

Sparse Solutions by a Quadratically Constrained ℓ q (0 <

Asymmetric and robust loss function driven least squares support vector machine

Relative Regularity Conditions and Linear Regularity Properties for Split Feasibility Problems in Normed Linear Spaces

The least squares problem of the matrix equation + =

Relation Between a Support Vector Machine and the Least Square Method

Sparse Solutions by a Quadratically Constrained ℓq (0 <<i>q</i>< 1) Minimization Model

A New Implementation of LSMR Algorithm for the Quaternionic Least Squares Problem

Condition Numbers of Multidimensional Mixed Least Squares-Total Least Squares Problems

Sparse Solutions by a Quadratically Constrained <i>l<sub>q</sub></i> (0 < <i>q</i> < 1) Minimization Model

A QR DECOMPOSITION BASED SOLVER FOR THE LEAST SQUARES PROBLEMS FROM THE MINIMAL RESIDUAL METHOD FOR THE SYLVESTER EQUATION

On Local Minimizers of Quadratically Constrained Nonconvex Homogeneous Quadratic Optimization with at Most Two Constraints

A Note on the Scaled Total Least Squares Problem

A MODEL FUNCTION METHOD IN TOTAL LEAST SQUARES

Minimizing Quotient Regularization Model