Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained ℓ q (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained ℓ q (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained ℓ q minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained ℓ q minimization model extends the linearly constrained ℓ q and unconstrained ℓ 2 - ℓ q models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

An efficient algorithm for globally minimizing sum of quadratic ratios problem with nonconvex quadratic constraints

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

Global optimization of nonlinear sum of ratios problem

A New branch-and-cut algorithm for linear sum-of-ratios problem based on SLO method and LO relaxation

A New Global Optimization Method Based on Simplex Branching for Solving a Class of Non-Convex QCQP Problems

A QCQP-based splitting SQP algorithm for two-block nonconvex constrained optimization problems with application

A nonlinear relaxation-strategy-based algorithm for solving sum-of-linear-ratios problems

A deterministic global optimization algorithm

A New Algorithm for Finding Global Solution of Indefinite Quadratic Programming Problems

Effective outcome space branch-and-bound algorithm for solving the sum of affine ratios problem

An Eigenvalue Decomposition Based Branch-and-bound Algorithm for Nonconvex Quadratic Programming Problems with Convex Quadratic Constraints

Globally maximizing the ratio of two generalized quadratic matrix form functions over the Stiefel manifold

A new global optimization algorithm for signomial geometric programming via Lagrangian relaxation

Incremental Subgradient Methods for Minimizing The Sum of Quasi-convex Functions

Lagrange Multiplier Local Necessary and Global Sufficiency Criteria for Some Non-Convex Programming Problems

Global solutions of nonconvex standard quadratic programs via mixed integer linear programming reformulations

Globally Solving Quadratic Programs with Convex Objective and Complementarity Constraints Via Completely Positive Programming

An Improved Sequential Quadratic Programming Algorithm for Solving General Nonlinear Programming Problems

New global algorithms for quadratic programming with a few negative eigenvalues based on alternative direction method and convex relaxation

Sparse Solutions by a Quadratically Constrained ℓ q (0 <