Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained ℓ q (0 < q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained ℓ q (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained ℓ q minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained ℓ q minimization model extends the linearly constrained ℓ q and unconstrained ℓ 2 - ℓ q models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

Solving Symmetric and Positive Definite Second-Order Cone Linear Complementarity Problem by a Rational Krylov Subspace Method

A Krylov Subspace Method for Large-Scale Second-Order Cone Linear Complementarity Problem

An Efficient Algorithm For Second-Order Cone Linear Complementarity Problems

An Efficient Matrix Splitting Method for the Second-Order Cone Complementarity Problem

The Globally Uniquely Solvable Property of Second-Order Cone Linear Complementarity Problems

An inexact smoothing method for the monotone complementarity problem over symmetric cones

A semi-conjugate gradient method for solving unsymmetric positive definite linear systems

Smoothing penalty approach for solving second-order cone complementarity problems

Computation Algorithm for Convex Semi-infinite Program with Second-Order Cones: Special Analyses for Affine and Quadratic Case

Computable Representation of the Cone of Nonnegative Quadratic Forms over A General Second-Order Cone and Its Application to Completely Positive Programming

Quadratic Optimization over a Second-Order Cone with Linear Equality Constraints

Optimality Conditions for Problems over Symmetric Cones and a Simple Augmented Lagrangian Method

A Second-Order Cone Based Approach for Solving the Trust Region Subproblem and Its Variants

A Primal-Dual Framework for Symmetric Cone Programming

Conic Approximation to Quadratic Optimization with Linear Complementarity Constraints.

The GUS-property of second-order cone linear complementarity problems

Solving Conic Systems via Projection and Rescaling

IPRSOCP: A Primal-Dual Interior-Point Relaxation Algorithm for Second-Order Cone Programming

Sparse Solutions by a Quadratically Constrained ℓ q (0 <

The Convergence of Krylov Subspace Methods for Large Unsymmetric Linear Systems

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming