Abstract:Many real-world problems involve the recovery of a matrix from linear measurements, where the matrix lies close to some low-dimensional structure. This paper considers the problem of reconstructing a matrix with a simultaneously sparse and low-rank model. As surrogate functions of the sparsity and the matrix rank that are non-convex and discontinuous, the l(1) norm and the nuclear norm are often used instead to derive efficient algorithms to promote sparse and low-rank characteristics, respectively. However, the l(1) norm and the nuclear norm are loose approximations, and furthermore, recent study reveals using convex regularizations for joint structures cannot do better, orderwise, than exploiting only one of the structures. Motivated by the construction of non-convex and nonseparable regularization in sparse Bayesian learning, a new optimization problem is formulated in the latent space for recovering a simultaneously sparse and low-rank matrix. The newly proposed non-convex cost function is proved to have the ability to recover a simultaneously sparse and low-rank matrix with a sufficient number of noiseless linear measurements. In addition, an algorithm is derived to solve the resulting non-convex optimization problem, and convergence analysis of the proposed algorithm is provided in this paper. The performance of the proposed approach is demonstrated by experiments using both synthetic data and real hyperspectral images for compressive sensing applications.

Regularized Matrix Regression

Robust Regularized Low-Rank Matrix Models for Regression and Classification

A framework of regularized low-rank matrix models for regression and classification

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression

The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model

Regularization for High-Dimensional Covariance Matrix

Estimation of Sparse Covariance Matrix Via Non-Convex Regularization

Sparse and Low-Rank Matrix Quantile Estimation with Application to Quadratic Regression

Multiple Regression for Matrix and Vector Predictors: Models, Theory, Algorithms, and Beyond

The statistical rate for support matrix machines under low rankness and row (column) sparsity

Learnable Graph-Regularization for Matrix Decomposition

Regularity Properties for Sparse Regression

High-Dimensional Covariance Estimation Via Constrained Lq-Type Regularization

Sparse Covariance and Precision Random Design Regression

Regularization in High-Dimensional Regression and Classification via Random Matrix Theory

Simultaneously Sparse and Low-Rank Matrix Reconstruction Via Nonconvex and Nonseparable Regularization

Regularization Methods for Low-Rank Factorization of Matrices with Missing Data

L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses

Sparse matrix linear models for structured high-throughput data

Fast Low-Rank Matrix Learning with Nonconvex Regularization

Low Rank Spectral Regression Via Matrix Factorization for Efficient Subspace Learning