Abstract:Kernel-based nonlinear dictionary learning methods operate in a feature space obtained by an implicit feature map, and they are not independent of computationally expensive operations like Singular Value Decomposition (SVD). This paper presents an SVD-free lightweight approach to learning a nonlinear dictionary using a randomized functional link called a Random Vector Functional Link (RVFL). The proposed RVFL-based nonlinear Dictionary Learning (RVFLDL) learns a dictionary as a sparse-to-dense feature map from nonlinear sparse coefficients to the dense input features. Sparse coefficients w.r.t an initial random dictionary are derived by assuming Horseshoe prior are used as inputs making it a lightweight network. Training the RVFL-based dictionary is free from SVD computation as RVFL generates weights from the input to the output layer analytically. Higher-order dependencies between the input sparse coefficients and the dictionary atoms are incorporated into the training process by nonlinearly transforming the sparse coefficients and adding them as enhanced features. Thus the method projects sparse coefficients to a higher dimensional space while inducing nonlinearities into the dictionary. For classification using RVFL-net, a classifier matrix is learned as a transform that maps nonlinear sparse coefficients to the labels. The empirical evidence of the method illustrated in image classification and reconstruction applications shows that RVFLDL is scalable and provides a solution better than those obtained using other nonlinear dictionary learning methods.

Nonlinear Dictionary Learning Based Deep Neural Networks

Nonlinear dictionary learning algorithm with nonconvex regularizations

A Novel Nonlinear Dictionary Learning Algorithm Based on Nonlinear-KSVD and Nonlinear-MOD

Joint Deep Dictionary Learning

Hierarchical Nonlinear Dictionary Learning with Convolutional Neural Networks: Application to Sar Target Recognition

A Novel Image Classification Method Based on Multi-layer Dictionary Learning

How to Train Your Deep Neural Network with Dictionary Learning

An efficient learned dictionary and its application to non-local denoising

Kernel Regularized Nonlinear Dictionary Learning for Sparse Coding

Convolutional Dictionary Pair Learning Network for Image Representation Learning

A Lightweight Randomized Nonlinear Dictionary Learning Method using Random Vector Functional Link

Jointly Learning Non-negative Projection and Dictionary with Discriminative Graph Constraints for Classification

Discriminative Nonlinear Analysis Operator Learning: when Cosparse Model Meets Image Classification.

DL2: Dictionary Learning Regularized with Deep Learning Prior for Simultaneous Denoising and Interpolation

An Efficient and Interpre Table Speech Enhancement Network Via Deep Dictionary Learning.

Dictionary Learning in Convolutional Sparse Representation

Nonlinear Non-Negative Matrix Factorization Using Deep Learning.

Dictionary Learning by Dynamical Neural Networks

Deep Micro-Dictionary Learning and Coding Network

Self-Taught Semisupervised Dictionary Learning with Nonnegative Constraint

When Dictionary Learning Meets Deep Learning: Deep Dictionary Learning and Coding Network for Image Recognition with Limited Data