Abstract:The sparse modeling is an evident manifestation capturing the parsimony principle just described, and sparse models are widespread in statistics, physics, information sciences, neuroscience, computational mathematics, and so on. In statistics the many applications of sparse modeling span regression, classification tasks, graphical model selection, sparse M-estimators and sparse dimensionality reduction. It is also particularly effective in many statistical and machine learning areas where the primary goal is to discover predictive patterns from data which would enhance our understanding and control of underlying physical, biological, and other natural processes, beyond just building accurate outcome black-box predictors. Common examples include selecting biomarkers in biological procedures, finding relevant brain activity locations which are predictive about brain states and processes based on fMRI data, and identifying network bottlenecks best explaining end-to-end performance. Moreover, the research and applications of efficient recovery of high-dimensional sparse signals from a relatively small number of observations, which is the main focus of compressed sensing or compressive sensing, have rapidly grown and became an extremely intense area of study beyond classical signal processing. Likewise interestingly, sparse modeling is directly related to various artificial vision tasks, such as image denoising, segmentation, restoration and superresolution, object or face detection and recognition in visual scenes, and action recognition. In this manuscript, we provide a brief introduction of the basic theory underlying sparse representation and compressive sensing, and then discuss some methods for recovering sparse solutions to optimization problems in effective way, together with some applications of sparse recovery in a machine learning problem known as sparse dictionary learning.

Sparse Recovery: from Vectors to Tensors

Feature Selection from High-Order Tensorial Data Via Sparse Decomposition

Efficient Recovery of Structured Sparse Signals Via Approximate Message Passing with Structured Spike and Slab Prior

Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery.

Sparsity optimized compressed sensing image recovery

On Sparse Recovery Algorithms in Unions of Orthonormal Bases

Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors

A Novel Sparsity Measure for Tensor Recovery

Block-Sparse Tensor Recovery

Sparse Recovery for Overcomplete Frames: Sensing Matrices and Recovery Guarantees

Distributed Multi-View Sparse Vector Recovery

Exploiting Global Low-Rank Structure and Local Sparsity Nature for Tensor Completion.

Sparse Models for Machine Learning

Compressive Tensor Sampling with Structured Sparsity

The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information

Survey on Sparsity in Geometric Modeling and Processing

Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery

Tensor Low-Rank Representation for Data Recovery and Clustering

A Sparse Tensor Generator with Efficient Feature Extraction

Recovery of Low-Rank Plus Compressed Sparse Matrices with Application to Unveiling Traffic Anomalies

Compressive Recovery of Sparse Precision Matrices