Abstract:Sparse coding, which aims at finding appropriate sparse representations of data with an overcomplete dictionary set, is a well-established signal processing methodology and has good efficiency in various areas. The varying sparse constraint can influence the performances of sparse coding algorithms greatly. However, commonly used sparse regularization may not be robust in high-coherence condition. In this paper, inspired from independently interpretable lasso (IILasso), which considers the coherence of sensing matrix columns in constraint to implement the strategy of selecting uncorrelated variables, we propose a new regularization by introducing ℓ p norm (0 <; p <; 1) into the regularization part of IILasso. The new regularization can efficiently enhance the performances in obtaining sparse and accurate coefficient. To solve the optimization problem with the new regularization, we propose to use the coordinate descent algorithm with weighted ℓ 1 norm, named independently interpretable weighted lasso (IIWLasso), and the proximal operator, named independently interpretable iterative shrinkage thresholding algorithm (II-ISTA) and independently interpretable proximal operator for ℓ 2/3 thetic data experiments and gene expression data experiments to validate the performance of our proposed algorithms. The experiment results show that all independently interpretable algorithms can perform better than their original ones in different coherence conditions. Among them, IIWLasso can obtain relatively best performance both in relative norm error and support error of synthetic data and misclassification error of tenfold cross-validating gene expression data.

Group sparse optimization via $\ell_{p,q}$ regularization

Group sparse optimization via l

Group Sparse Optimization Via Lp, Q Regularization.

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Computing the Proximal Operator of the $\ell_{1,q}$-norm for Group Sparsity

Revisiting $L_q(0\leq q<1)$ Norm Regularized Optimization

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

ℓ _1/2,1 group sparse regularization for compressive sensing

Group Sparse Recovery Via the $\ell ^0(\ell ^2)$ Penalty: Theory and Algorithm

Sparsity via Sparse Group $k$-max Regularization

Difference-of-Convex Algorithms for a Class of Sparse Group $\ell_0$ Regularized Optimization Problems

Sparse Kernel Regression with Coefficient-based $\Ell_q-$Regularization.

Regularization for Compressive Sensing

Sparse Portfolio Selection via Quasi-Norm Regularization

Inexact FPPA for the $\ell_0$ Sparse Regularization Problem

Reduced-Space Iteratively Reweighted Second-Order Methods for Nonconvex Sparse Regularization

A proximal-gradient method for problems with overlapping group-sparse regularization: support identification complexity

$α\ell_{1}-β\ell_{2}$ sparsity regularization for nonlinear ill-posed problems

$\Ell_p$ Norm Independently Interpretable Regularization Based Sparse Coding for Highly Correlated Data

Subspace Newton method for sparse group optimization problem