Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained [Formula: see text] (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained [Formula: see text] (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained [Formula: see text] minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained [Formula: see text] minimization model extends the linearly constrained [Formula: see text] and unconstrained [Formula: see text]-[Formula: see text] models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

Total least squares adjustment in inequality constrained partial errors-in-variables models: optimality conditions and algorithms

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Weighted total least squares problems with inequality constraints solved by standard least squares theory

An Improved Smoothing Technique-Based Control Vector Parameterization Method for Optimal Control Problems with Inequality Path Constraints

Minimum Total Error Entropy Method for Parameter Estimation

Homotopy nonlinear weighted total least squares adjustment

The Convergence of Least-Squares Progressive Iterative Approximation for Singular Least-Squares Fitting System.

A new inexact SQP algorithm for nonlinear systems of mixed equalities and inequalities

Calibrating Least Squares Semidefinite Programming with Equality and Inequality Constraints

A subspace SQP method for equality constrained optimization

A Matrix-Free Trust-Region SQP Method for Equality Constrained Optimization

Smoothing SQP methods for solving degenerate nonsmooth constrained optimization problems with applications to bilevel programs

Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programming

Sequential Quadratic Programming Method for Nonlinear Least Squares Estimation and Its Application

Orthogonality-based bias-corrected empirical likelihood inference for partial linear varying coefficient EV models with longitudinal data

Learning non-smooth models: instrumental variable quantile regressions and related problems

A sequential quadratic programming algorithm for equality-constrained optimization without derivatives

Sparse Solutions by a Quadratically Constrained ℓq (0 <<i>q</i>< 1) Minimization Model

A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

Quantile regression and variable selection of partial linear single-index model

Improved Least Square Method Based on Theory of Programming and Application in Parameters Estimating of Markov Jumping Systems