Abstract:Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theoretical research and practical applications. Many different algorithms have been proposed for sparse representation. The main purpose of this article is to provide a comprehensive study and an updated review on sparse representation and to supply a guidance for researchers. The taxonomy of sparse representation methods can be studied from various viewpoints. For example, in terms of different norm minimizations used in sparsity constraints, the methods can be roughly categorized into five groups: sparse representation with $l_0$-norm minimization, sparse representation with $l_p$-norm (0$<$p$<$1) minimization, sparse representation with $l_1$-norm minimization and sparse representation with $l_{2,1}$-norm minimization. In this paper, a comprehensive overview of sparse representation is provided. The available sparse representation algorithms can also be empirically categorized into four groups: greedy strategy approximation, constrained optimization, proximity algorithm-based optimization, and homotopy algorithm-based sparse representation. The rationales of different algorithms in each category are analyzed and a wide range of sparse representation applications are summarized, which could sufficiently reveal the potential nature of the sparse representation theory. Specifically, an experimentally comparative study of these sparse representation algorithms was presented. The Matlab code used in this paper can be available at: http://www.yongxu.org/lunwen.html.

Robust Survey Aggregation with Student-t Distribution and Sparse Representation.

Asynchronous Byzantine-Robust Stochastic Aggregation with Variance Reduction for Distributed Learning

Semi-supervised Variational Bayesian Student’s T Mixture Regression and Robust Inferential Sensor Application

Distributed Sparse Total Least-Squares over Networks

Recover Fine-Grained Spatial Data from Coarse Aggregation

Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions

Generalized Local Aggregation for Large Scale Gaussian Process Regression

A survey of sparse representation: algorithms and applications

Robust Bayesian Compressed sensing

Robust Sparse Mean Estimation via Sum of Squares

Online Student-$t$ Processes with an Overall-local Scale Structure for Modelling Non-stationary Data

Robust Bayesian Filtering and Smoothing Using Student's t Distribution

Toward a robust and fast real-time point cloud registration with factor analysis and Student’s-t mixture model

A Robust Particle Filtering Algorithm with Non-Gaussian Measurement Noise Using Student-t Distribution.

Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework

Study of Robust Direction Finding Based on Joint Sparse Representation

Aggregation Models with Optimal Weights for Distributed Gaussian Processes

Robust Bayesian Compressed Sensing with Outliers

Error-bounded Sampling for Analytics on Big Sparse Data

An Analytical Subspace-Based Robust Sparse Bayesian Inference Estimator for Off-Grid TDOA Localization

Transfer Sparse Coding for Robust Image Representation