Abstract:We present a fast, efficient algorithm for learning an overcomplete dictionary for sparse representation of signals. The whole problem is considered as a minimization of the approximation error function with a coherence penalty for the dictionary atoms and with the sparsity regularization of the coefficient matrix. Because the problem is nonconvex and nonsmooth, this minimization problem cannot be solved efficiently by an ordinary optimization method. We propose a decomposition scheme and an alternating optimization that can turn the problem into a set of minimizations of piecewise quadratic and univariate subproblems, each of which is a single variable vector problem, of either one dictionary atom or one coefficient vector. Although the subproblems are still nonsmooth, remarkably they become much simpler so that we can find a closed-form solution by introducing a proximal operator. This leads to an efficient algorithm for sparse representation. To our knowledge, applying the proximal operator to the problem with an incoherence term and obtaining the optimal dictionary atoms in closed form with a proximal operator technique have not previously been studied. The main advantages of the proposed algorithm are that, as suggested by our analysis and simulation study, it has lower computational complexity and a higher convergence rate than state-of-the-art algorithms. In addition, for real applications, it shows good performance and significant reductions in computational time.

A Quick MP Algorithm of Sparse Decomposition by Overcomplete Dictionary Combined by Orthogonal Bases

An MP sparse decomposition algorithm with 2-step search method based on partitioning the over-complete dictionary

A New Method for Signal Sparse Decomposition

On Sparse Recovery Algorithms in Unions of Orthonormal Bases

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Two Dictionaries Matching Pursuit for Sparse Decomposition of Signals

A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators

A modified MP Algorithm Constrained by the Simulate Annealing Threshold for Sparse Decomposition of Signals

The Application of Sparse Component Decomposition in the Over-complete Dictionary to Signal Representation

A new algorithm on hierarchical sparse signal reconstruction

A novel signal sparse decomposition based on modulation correlation partition

Iterative Weighted Method of Sparse Decomposition and Preliminary Application

Greed is Good: Algorithmic Results for Sparse Approximation

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

A sparse interpolation algorithm based on modular arithmetic coefficient parsing

An overcomplete dictionary design algorithm for sparse representation of piecewise stationary signals

A block orthogonal matching pursuit algorithm based on sensing dictionary

Noise Reduction by A New Iterative Weighted Sparse Decomposition Algorithm

Single-channel Speech Separation Using Orthogonal Matching Pursuit.

The Compression Algorithm for Electrocardiogram Based on Sparse Decomposition

Speech Recognition Based on Improved MP Sparse Decomposition Algorithm