Abstract:Sparse representations of data or signals have drawn considerable attentions in the past decade. In this paper, we focus on the problem of training high-efficacy dictionaries for remote sensing images of massive long-time sequences. By extending the classical K-SVD, we propose a new dictionaries learning algorithm. Different from K-SVD, in the proposed incremental K-SVD algorithm, we selectively train a certain number of atoms when each new batch of sample data are added into the training process; current dictionary are replenished by the selected and enhanced atoms. The new atoms are initialized by information entropy. Meanwhile, we introduce an uncertainty metric to determine whether or not new atoms should be added into the current dictionary. To efficiently and sparsely represent the long-time sequence data set, we also de-correlate the dictionary based on new atoms by introducing a mutual coherence constraint into the atom updating stage. The method presented in this paper aims to adaptively and dynamically train the dictionary from big data. Two other state-of-the-art dictionary learning methods such as online dictionary learning (ODL) and recursive least squares dictionary learning algorithm (RLS-DLA) who also could train the dictionary using relatively large data, are comprehensively compared with the proposed algorithm in both sparse model and error model. In the sparse model, the reconstruction error of the DUK-SVD dictionary was smaller than ODL and RLS-DLA. In the error model, the sparsity of the DUK-SVD was higher than ODL and RLS-DLA. We can also observe that in the sparse model the proposed DUK-SVD often consume fewer computing time than ODL.

Sparse Dictionary Leaming Based on Optimization of Surrogate Function

Sparse dictionary learning based on optimization of surrogate function

Sparse Representation over Overcomplete Dictionary Based on Bayesian Nonparametric Approximation

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

A Novel Dictionary Learning Method for Sparse Representation with Nonconvex Regularizations.

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

An Efficient Dictionary Learning Algorithm for Sparse Representation

Iterative Dictionary Learning Based on Nonconvex Sparse Regularization and Adaptive Parameter Control

Dictionary Learning With Log-Regularizer For Sparse Representation

Optimization of Learned Dictionary for Sparse Coding in Speech Processing.

Adaptive Submodular Dictionary Selection for Sparse Representation Modeling with Application to Image Super-Resolution

Forward Basis Selection for Sparse Approximation over Dictionary

Designing optimal sparsifying dictionary using first order series expansion

Blockwise coordinate descent schemes for sparse representation

Dictionary learning under global sparsity constraint

Kernel Regularized Nonlinear Dictionary Learning for Sparse Coding

Learning Block-Structured Incoherent Dictionaries for Sparse Representation

Dictionary Evaluation and Optimization for Sparse Coding Based Speech Processing

A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators

DUK-SVD: Dynamic Dictionary Updating for Sparse Representation of a Long-Time Remote Sensing Image Sequence