Abstract:As one of the essential deep learning models, a restricted Boltzmann machine (RBM) is a commonly used generative training model. By adaptively growing the size of the hidden units, infinite RBM (IRBM) is obtained, which possesses an excellent property of automatically choosing the hidden layer size depending on a specific task. An IRBM presents a competitive generative capability with the traditional RBM. First, a generative model called Gaussian IRBM (GIRBM) is proposed to deal with practical scenarios from the perspective of data discretization. Subsequently, a discriminative IRBM (DIRBM) and a discriminative GIRBM (DGIRBM) are established to solve classification problems by attaching extra-label units next to the input layer. They are motivated by the fact that a discriminative variant of an RBM can complete an individual framework for classification with better performance than some standard classifiers. Remarkably, the proposed models retain both generative and discriminative properties synchronously, that is, they can reconstruct data effectively and be established in considerable self-contained classifiers. The experimental results on image classification (both large and small), text identification, and facial recognition (both clean and noisy) reflect that a DIRBM and a DGIRBM are superior to some state-of-the-art RBM models in terms of the reconstruction error and the classification accuracy. Intuitively, they require models to avoid utilizing more hidden units than needed when confronted with various sizes of data, prioritizing smaller networks. In addition, the proposed models behave more robustly than other classic classifiers when dealing with noisy facial recognition.

Discriminative Matrix-Variate Restricted Boltzmann Machine Classification Model

Matrix Variate RBM and Its Applications.

Generative and Discriminative Infinite Restricted Boltzmann Machine Training

Matrix Variate Restricted Boltzmann Machine based on Canonical Polyadic Decomposition

Matrix Variate RBM Model with Gaussian Distributions.

Matrix Product Operator Restricted Boltzmann Machines

Matrix-based Vs. Vector-Based Linear Discriminant Analysis: A Comparison of Regularized Variants on Multivariate Time Series Data.

Integrating Supervised Subspace Criteria with Restricted Boltzmann Machine for Feature Extraction

Fault Diagnosis Based on Sparse Class Gaussian Restrict Boltzmann Machine Model

Classification Model of Restricted Boltzmann Machine Based on Reconstruction Error.

Mixed-Variate Restricted Boltzmann Machines

From Class-Specific to Class-Mixture: Cascaded Feature Representations Via Restricted Boltzmann Machine Learning.

Multiple Rank Multi-Linear SVM for Matrix Data Classification.

Regularized Bilinear Discriminant Analysis for Multivariate Time Series Data

Tensorizing Restricted Boltzmann Machine

Rényi Divergence Based Generalization for Learning of Classification Restricted Boltzmann Machines

Gaussian Cardinality Restricted Boltzmann Machines.

Multiple Rank Multi-Linear Twin Support Matrix Classification Machine

A New Regularized Restricted Boltzmann Machine Based on Class Preserving

Probabilistic Feature Selection and Classification Vector Machine