Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained [Formula: see text] (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained [Formula: see text] (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained [Formula: see text] minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained [Formula: see text] minimization model extends the linearly constrained [Formula: see text] and unconstrained [Formula: see text]-[Formula: see text] models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

A Quasi-Minimal Residual Variant of the BiCORSTAB Method for Nonsymmetric Linear Systems

A Hybrid Variant of the BiCOR Method for a Nonsymmetric Linear System with a Complex Spectrum

Exploiting the Composite Step Strategy to the Biconjugate A-Orthogonal Residual Method for Non-Hermitian Linear Systems

A Hybridized Iterative Algorithm of the Bicorstab and Gpbicor Methods for Solving Non-Hermitian Linear Systems

An Enhancement of the Accuracy of the BiCGStab Method for Solving Linear Systems with Single or Multiple Right-Hand Sides

Quasi-Minimal Residual Variants of the COCG and COCR Methods for Complex Symmetric Linear Systems in Electromagnetic Simulations

Investigating the composite step biconjugate A-orthogonal residual method for non-hermitian dense linear systems in electromagnetics

Lanczos-type Variants of the COCR Method for Complex Nonsymmetric Linear Systems

A generalized product-type BiCOR method and its application in signal deconvolution

BiCGCR2: A New Extension of Conjugate Residual Method for Solving Non-Hermitian Linear Systems

Preconditioned BiCGSTAB and BiCRSTAB methods for solving the Sylvester tensor equation

QQMR: A Structure-Preserving Quaternion Quasi-Minimal Residual Method for Non-Hermitian Quaternion Linear Systems

Conjugate Residual Squared Method and Its Improvement for Non-Symmetric Linear Systems.

A Preconditioned MINRES Method for Block Lower Triangular Toeplitz Systems

Sparse Solutions by a Quadratically Constrained ℓ q (0 <

The BiCOR and CORS Iterative Algorithms for Solving Nonsymmetric Linear Systems.

Sparse Solutions by a Quadratically Constrained ℓq (0 <<i>q</i>< 1) Minimization Model

Recycling BiCGSTAB with an Application to Parametric Model Order Reduction

Comparison of Convergence Rate and Analysis of Robustness by Using Different Algebraic Equation Solution Methods

A New Projected Variant of the Deflated Block Conjugate Gradient Method