Abstract:Finding sparse solutions to a system of equations and/or inequalities is an important topic in many application areas such as signal processing, statistical regression and nonparametric modeling. Various continuous relaxation models have been proposed and widely studied to deal with the discrete nature of the underlying problem. In this paper, we propose a quadratically constrained l(q) (0< q < 1) minimization model for finding sparse solutions to a quadratic system. We prove that solving the proposed model is strongly NP-hard. To tackle the computation difficulty, a first order necessary condition for local minimizers is derived. Various properties of the proposed model are studied for designing an active-set-based descent algorithm to find candidate solutions satisfying the proposed condition. In addition to providing a theoretical convergence proof, we conduct extensive computational experiments using synthetic and real-life data to validate the effectiveness of the proposed algorithm and to show the superior capability in finding sparse solutions of the proposed model compared with other known models in the literature. We also extend our results to a quadratically constrained l(q) (0 < q < 1) minimization model with multiple convex quadratic constraints for further potential applications. Summary of Contribution: In this paper, we propose and study a quadratically constrained l(q) minimization (0 < q < 1) model for finding sparse solutions to a quadratic system which has wide applications in sparse signal recovery, image processing and machine learning. The proposed quadratically constrained l(q) minimization model extends the linearly constrained l(q) and unconstrained l(2)-l(q) models. We study various properties of the proposed model in aim of designing an efficient algorithm. Especially, we propose an unrelaxed KKT condition for local/global minimizers. Followed by the properties studied, an active-set based descent algorithm is then proposed with its convergence proof being given. Extensive numerical experiments with synthetic and real-life Sparco datasets are conducted to show that the proposed algorithm works very effectively and efficiently. Its sparse recovery capability is superior to that of other known models in the literature.

A differential equations approach to $l_1$-minimization with applications to array imaging

Minimization of differential equations and algebraic values of $E$-functions

Lp quasi-norm minimization: algorithm and applications

Minimizing L 1 over L 2 norms on the gradient

Smoothed sparse recovery via locally competitive algorithm and forward Euler discretization method.

On Partial Smoothness, Activity Identification and Faster Algorithms of L1 over L2 Minimization

Accelerated optimization algorithms and ordinary differential equations: the convex non Euclidean case

An $O(s^r)$-Resolution ODE Framework for Understanding Discrete-Time Algorithms and Applications to the Linear Convergence of Minimax Problems

A New Operator Splitting Method for the Euler Elastica Model for Image Smoothing.

Homotopy Based Algorithms for $\ell _{\scriptscriptstyle 0}$ -Regularized Least-Squares

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

Difference-of-Convex Algorithms for a Class of Sparse Group $\ell_0$ Regularized Optimization Problems

Efficient Decomposition-Based Algorithms for $\ell_1$-Regularized Inverse Problems with Column-Orthogonal and Kronecker Product Matrices

Smooth over-parameterized solvers for non-smooth structured optimization

On Partly Smoothness, Activity Identification and Faster Algorithms of $L_1$ over $L_2$ Minimization

Sparse Solutions by a Quadratically Constrained <i>l<sub>q</sub></i> (0 < <i>q</i> < 1) Minimization Model

Algorithmes De Type Homotopiques Pour La Minimisation Des Moindres Carrés Régularisés Par La "norme" $\Ell_0$

A Stochastic Proximal Alternating Minimization for Nonsmooth and Nonconvex Optimization

A sparse spectral method for fractional differential equations in one-spatial dimension

A HYBRID ALTERNATING MINIMIZATION ALGORITHM FOR STRUCTURED CONVEX OPTIMIZATION PROBLEMS WITH APPLICATION IN POISSONIAN IMAGE PROCESSING

On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights