Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained [Formula: see text] (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained [Formula: see text] (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained [Formula: see text] minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained [Formula: see text] minimization model extends the linearly constrained [Formula: see text] and unconstrained [Formula: see text]-[Formula: see text] models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

A block Lanczos method for large-scale quadratic minimization problems with orthogonality constraints

Convergence of the block Lanczos method for the trust‐region subproblem in the hard case

An Effective Dynamic Optimization Method Based on Modified Orthogonal Collocation and Reduced SQP

A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints

Parallelizable Algorithms for Optimization Problems with Orthogonality Constraints

Structured Quasi-Newton Methods for Optimization with Orthogonality Constraints.

Sparse Solutions by a Quadratically Constrained ℓ q (0 <

A QCQP-based splitting SQP algorithm for two-block nonconvex constrained optimization problems with application

An Eigenvalue Decomposition Method for Low-rank and Non-convex Quadratically Constrained Quadratic Programming

A block symmetric Gauss-Seidel decomposition theorem for convex composite quadratic programming and its applications

The Augmented Lagrangian Method with Full Jacobian Decomposition and Logarithmic-Quadratic Proximal Regularization for Multiple-Block Separable Convex Programming

Block Coordinate Descent Methods for Optimization under J-Orthogonality Constraints with Applications

Block majorization-minimization with diminishing radius for constrained nonconvex optimization

Generalized Block Lanczos Methods for Large Unsymmetric Eigenproblems

Greedy Block Extended Kaczmarz Method for Solving the Least Squares Problems

Sparse Solutions by a Quadratically Constrained ℓq (0 <<i>q</i>< 1) Minimization Model

Orthogonal Block Kaczmarz Algorithm Based on Preprocessing Technology

Blockwise Stochastic Variance-Reduced Methods with Parallel Speedup for Multi-Block Bilevel Optimization

A spectrally preconditioned and initially deflated variant of the restarted block GMRES method for solving multiple right-hand sides linear systems

A Proximal Peaceman-Rachford Splitting Method for Solving the Multi-Block Separable Convex Minimization Problems.

A Splitting Method for Orthogonality Constrained Problems