Abstract:Nonnegative sparse representation has become highly popular in certain applications in the context of signals and corresponding dictionaries that have nonnegative limitations. Applying an adaptive dictionary for sparse representation of nonnegative signals has been shown to be very effective; but constructing adaptive dictionary, i.e., dictionary learning, remains a challenge. In this paper, we attempt to design an effective and tailored algorithm for the sparse representation of nonnegative signals. We consider the so-called determinant sparsity measure formed with the determinant of the Gram matrix of sparse coefficients. Based on the determinant measure, we formulate the nonnegative dictionary learning problem that is optimization of a non-convex function. For reducing the computational complexity of the optimization, the difference of convex functions (DC) programming is employed since the non-convex function can be set to the form of difference of two convex functions. Because there are two variables in the dictionary learning problem that cannot be solved directly by DC programming, an alternation scheme is employed to treat the sparse coding and dictionary update of the dictionary learning problem alternatively with the DC programming Our proposed novel dictionary learning algorithm has three advantages: 1) the higher recovery ratio is achieved by the proposed algorithm, even when the signals are weakly sparse; 2) the generalization ability of the proposed algorithm is greater, more often converging to a global solution than to local optimal solutions; and 3) the obtained sparse solution has a low-overlapping property that enables the solutions to be sparse and makes the proposed algorithm robust. Numerical experiments and experiments using real-world data demonstrate the effectiveness and applicability of the proposed algorithm.

A New Method for Signal Sparse Decomposition

An MP sparse decomposition algorithm with 2-step search method based on partitioning the over-complete dictionary

A Quick MP Algorithm of Sparse Decomposition by Overcomplete Dictionary Combined by Orthogonal Bases

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Compressed Data Separation Via Unconstrained L1-Split Analysis

A novel signal sparse decomposition based on modulation correlation partition

A new algorithm on hierarchical sparse signal reconstruction

Two Dictionaries Matching Pursuit for Sparse Decomposition of Signals

Learning dictionary from signals under global sparsity constraint

The Application of Sparse Component Decomposition in the Over-complete Dictionary to Signal Representation

Sparse Signal Subspace Decomposition Based on Adaptive Over-complete Dictionary

Sparse Signal Reconstruction Using Decomposition Algorithm

An overcomplete dictionary design algorithm for sparse representation of piecewise stationary signals

A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators

The method of signal sparse representation based on cascade multi-type over-complete atom dictionary

Iterative Weighted Method of Sparse Decomposition and Preliminary Application

A Novel Dictionary Design Algorithm for Sparse Representations

Analysis Sparse Representation for Nonnegative Signals Based on Determinant Measure by DC Programming

Nonnegative Sparse Representation of Signals with a Determinant-Type Sparsity Measure Based on the DC Programming

Sparse Signal Recovery Via Non-Convex Optimization and Overcomplete Dictionaries.

A modified MP Algorithm Constrained by the Simulate Annealing Threshold for Sparse Decomposition of Signals