Abstract:Sparse representation with an analysis model becomes a challenging task because the optimization problem involves additional constraints on the analysis dictionary. We present the problem of learning the analysis dictionary through an optimization function with an orthogonality constraint, which can be generally solved by alternately implementing the analysis dictionary update and the sparse coding steps. In the dictionary update step, the traditional method for updating the analysis dictionary with the orthogonality constraint is to first perform the update in Euclidean space without taking the constraint into consideration and then project the solution onto a manifold where the orthogonality constraint is satisfied. However, this projection method is approximate, and the learned dictionary obtained by projection may not embody the inherent structure of the original dictionary. Thus, we develop a novel framework for seamlessly learning the analysis dictionary along with the manifold. This method can provide a more accurate and effective analysis dictionary. In the sparse coding problem, to avoid adjustment of the parameters of the formulation, we introduce an indicator function as the penalty function for optimization of the cost function. Thus, we reduce two parameters to one, which is easier to optimize. Then, we adopt a Douglas–Rachford-like scheme to solve the problem. From the results of the numerical experiments conducted to evaluate the recovery rate of the analysis dictionary, we can intuitively see the performance of the proposed algorithms. Furthermore, the proposed algorithms show good performance in image denoising for realistic applications.

Analysis Dictionary Learning Using Block Coordinate Descent Framework with Proximal Operators

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

An Efficient Algorithm for Incoherent Analysis Dictionary Learning Based on Proximal Operator

Proximal Alternating Minimization for Analysis Dictionary Learning and Convergence Analysis

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Constrained Analysis Dictionary Learning with the L(1/2)-Norm Regularizer

Analysis Dictionary Learning Based on Summation of Blocked Determinants Measure of Sparseness

Learning Block-Structured Incoherent Dictionaries for Sparse Representation

A dictionary-learning algorithm for the analysis sparse model with a determinant-type of sparsity measure

Nonnegative Dictionary-Learning Algorithm Based on L1 Norm with the Sparse Analysis Model

Non-negative Dictionary-Learning Algorithm for the Analysis Model Based on L1 Norm.

Block dictionary learning with l0 regularization and its application in image denoising.

A Fast Algorithm for Learning Overcomplete Dictionary for Sparse Representation Based on Proximal Operators

Sparse Representation Based on the Analysis Model with Optimization on the Stiefel Manifold

Block dictionary learning with l<inf>0</inf> regularization and its application in image denoising

Dictionary Learning with the Cosparse Analysis Model Based on Summation of Blocked Determinants As the Sparseness Measure

Analysis Sparse Representation for Nonnegative Signals Based on Determinant Measure by DC Programming

Dictionary Learning with ℓ1/2 Regularizer for Sparsity Based on Proximal Operator

Dictionary Learning in the Analysis Sparse Representation with Optimization on Stiefel Manifold

An Efficient Algorithm for Dictionary Learning with a Mixed-Norm Regularizer for Sparsity Based on Proximal Operator.

Blockwise coordinate descent schemes for sparse representation