Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained [Formula: see text] (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained [Formula: see text] (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained [Formula: see text] minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained [Formula: see text] minimization model extends the linearly constrained [Formula: see text] and unconstrained [Formula: see text]-[Formula: see text] models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

Symmetric Low‐rank Corrections to Quadratic Models

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

New Model Correcting Method for Quadratic Eigenvalue Problems Using a Symmetric Eigenstructure Assignment

Low-Rank Updates of Matrix Square Roots

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression

A New Model Updating Method for Quadratic Eigenvalue Problems

Subsampling for Big Data Linear Models with Measurement Errors

A New Model Updating Method for Quadratic Eigenvalue Problems. II

Updating Quadratic Models with No Spillover Effect on Unmeasured Spectral Data

Sparse Solutions by a Quadratically Constrained ℓq (0 <<i>q</i>< 1) Minimization Model

Low-rank matrix estimation in multi-response regression with measurement errors: Statistical and computational guarantees.

Successively Alternate Least Square for Low-Rank Matrix Factorization with Bounded Missing Data

Sparse Solutions by a Quadratically Constrained ℓ q (0 <

A Sherman--Morrison--Woodbury approach to solving least squares problems with low-rank updates

Inverse Sensitivity Method for Asymmetric Multivariable Nondefective Systems

UPDATING QUADRATIC MODELS WITH NO SPILLOVER DRAFT AS OF July 14 , 2006

Correcting the estimator for the mean vectors in a multivariate errors-in-variables regression model

Low-rank matrix estimation via nonconvex optimization methods in multi-response errors-in-variables regression

An inverse eigenvalue problem and a matrix approximation problem for symmetric skew-hamiltonian matrices

Sparse Solutions by a Quadratically Constrained <i>l<sub>q</sub></i> (0 < <i>q</i> < 1) Minimization Model