Abstract:The dictionary pair learning (DPL) model aims to design a synthesis dictionary and an analysis dictionary to accomplish the goal of rapid sample encoding. In this article, we propose a novel structured representation learning algorithm based on the DPL for image classification. It is referred to as discriminative DPL with scale-constrained structured representation (DPL-SCSR). The proposed DPL-SCSR utilizes the binary label matrix of dictionary atoms to project the representation into the corresponding label space of the training samples. By imposing a non-negative constraint, the learned representation adaptively approximates a block-diagonal structure. This innovative transformation is also capable of controlling the scale of the block-diagonal representation by enforcing the sum of within-class coefficients of each sample to 1, which means that the dictionary atoms of each class compete to represent the samples from the same class. This implies that the requirement of similarity preservation is considered from the perspective of the constraint on the sum of coefficients. More importantly, the DPL-SCSR does not need to design a classifier in the representation space as the label matrix of the dictionary can also be used as an efficient linear classifier. Finally, the DPL-SCSR imposes the l<sub>2,p</sub> -norm on the analysis dictionary to make the process of feature extraction more interpretable. The DPL-SCSR seamlessly incorporates the scale-constrained structured representation learning, within-class similarity preservation of representation, and the linear classifier into one regularization term, which dramatically reduces the complexity of training and parameter tuning. The experimental results on several popular image classification datasets show that our DPL-SCSR can deliver superior performance compared with the state-of-the-art (SOTA) dictionary learning methods. The MATLAB code of this article is available at https://github.com/chenzhe207/DPL-SCSR.

Understanding L4-Based Dictionary Learning: Interpretation, Stability, and Robustness.

Complete Dictionary Learning via $\ell^4$-Norm Maximization over the Orthogonal Group

Complete Dictionary Learning Via L4-Norm Maximization over the Orthogonal Group

Multi-View Analysis Dictionary Learning for Image Classification.

A Fast Holistic Algorithm for Complete Dictionary Learning via ` Norm Maximization

An Efficient Orthonormalization-Free Approach for Sparse Dictionary Learning and Dual Principal Component Pursuit

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Decentralized Complete Dictionary Learning via $\ell^{4}$-Norm Maximization

Learning Dictionary on Manifolds for Image Classification

Robust Dictionary Learning and Sparse Coding with Riemannian Geometry Preserving Method in Symmetric Matrices Inner Product Space.

Discriminative Dictionary Pair Learning With Scale-Constrained Structured Representation for Image Classification

Low-Rank Plus Sparse Reconstruction Using Dictionary Learning for 3D-Mri

Laplacian Sparse Coding Dictionary for Image Set Based Collaborative Representation

Dictionary Learning with Structured Noise

Efficient Dictionary Learning with Sparseness-Enforcing Projections

A Non-Convex Relaxation Approach to Sparse Dictionary Learning

Dictionary Learning and Sparse Coding on Grassmann Manifolds: an Extrinsic Solution

NOODL: Provable Online Dictionary Learning and Sparse Coding

Sparse Coding and Dictionary Learning with Linear Dynamical Systems.

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

Learning Discriminative Dictionary for Group Sparse Representation.