Abstract:Nonnegative sparse representation has become highly popular in certain applications in the context of signals and corresponding dictionaries that have nonnegative limitations. Applying an adaptive dictionary for sparse representation of nonnegative signals has been shown to be very effective; but constructing adaptive dictionary, i.e., dictionary learning, remains a challenge. In this paper, we attempt to design an effective and tailored algorithm for the sparse representation of nonnegative signals. We consider the so-called determinant sparsity measure formed with the determinant of the Gram matrix of sparse coefficients. Based on the determinant measure, we formulate the nonnegative dictionary learning problem that is optimization of a non-convex function. For reducing the computational complexity of the optimization, the difference of convex functions (DC) programming is employed since the non-convex function can be set to the form of difference of two convex functions. Because there are two variables in the dictionary learning problem that cannot be solved directly by DC programming, an alternation scheme is employed to treat the sparse coding and dictionary update of the dictionary learning problem alternatively with the DC programming Our proposed novel dictionary learning algorithm has three advantages: 1) the higher recovery ratio is achieved by the proposed algorithm, even when the signals are weakly sparse; 2) the generalization ability of the proposed algorithm is greater, more often converging to a global solution than to local optimal solutions; and 3) the obtained sparse solution has a low-overlapping property that enables the solutions to be sparse and makes the proposed algorithm robust. Numerical experiments and experiments using real-world data demonstrate the effectiveness and applicability of the proposed algorithm.

Iterative Dictionary Learning Based on Nonconvex Sparse Regularization and Adaptive Parameter Control

A Novel Dictionary Learning Method for Sparse Representation with Nonconvex Regularizations.

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Nonlinear dictionary learning algorithm with nonconvex regularizations

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

Sparse Dictionary Leaming Based on Optimization of Surrogate Function

Dictionary Learning With Log-Regularizer For Sparse Representation

Dictionary Learning with &#x2113;<inf>1/2</inf> Regularizer for Sparsity Based on Proximal Operator

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Analysis Dictionary Learning Using Block Coordinate Descent Framework with Proximal Operators

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Dictionary Learning with ℓ1/2 Regularizer for Sparsity Based on Proximal Operator

An Efficient Dictionary Learning Algorithm for Sparse Representation

Kernel Regularized Nonlinear Dictionary Learning for Sparse Coding

Sparse dictionary learning based on optimization of surrogate function

A Novel Nonlinear Dictionary Learning Algorithm Based on Nonlinear-KSVD and Nonlinear-MOD

DUK-SVD: Dynamic Dictionary Updating for Sparse Representation of a Long-Time Remote Sensing Image Sequence

Nonnegative Sparse Representation of Signals with a Determinant-Type Sparsity Measure Based on the DC Programming

Dictionary Learning in Convolutional Sparse Representation

Dictionary Learning with the $${{\ell }_{1/2}}$$-Regularizer and the Coherence Penalty and Its Convergence Analysis

Robust Kernel Dictionary Learning Using a Whole Sequence Convergent Algorithm.