Abstract:As one of the essential deep learning models, a restricted Boltzmann machine (RBM) is a commonly used generative training model. By adaptively growing the size of the hidden units, infinite RBM (IRBM) is obtained, which possesses an excellent property of automatically choosing the hidden layer size depending on a specific task. An IRBM presents a competitive generative capability with the traditional RBM. First, a generative model called Gaussian IRBM (GIRBM) is proposed to deal with practical scenarios from the perspective of data discretization. Subsequently, a discriminative IRBM (DIRBM) and a discriminative GIRBM (DGIRBM) are established to solve classification problems by attaching extra-label units next to the input layer. They are motivated by the fact that a discriminative variant of an RBM can complete an individual framework for classification with better performance than some standard classifiers. Remarkably, the proposed models retain both generative and discriminative properties synchronously, that is, they can reconstruct data effectively and be established in considerable self-contained classifiers. The experimental results on image classification (both large and small), text identification, and facial recognition (both clean and noisy) reflect that a DIRBM and a DGIRBM are superior to some state-of-the-art RBM models in terms of the reconstruction error and the classification accuracy. Intuitively, they require models to avoid utilizing more hidden units than needed when confronted with various sizes of data, prioritizing smaller networks. In addition, the proposed models behave more robustly than other classic classifiers when dealing with noisy facial recognition.

Fault Diagnosis Based on Sparse Class Gaussian Restrict Boltzmann Machine Model

Fault Diagnosis Method Based on Improved Deep Boltzmann Machines

A Novel Bayesian Robust Model and Its Application for Fault Detection and Automatic Supervision of Nonlinear Process

A Novel Fault Detection and Diagnosis Method Based on Gaussian-Bernoulli Restricted Boltzmann Machine.

A Novel Bearing Fault Diagnosis Method Based on Gaussian Restricted Boltzmann Machine

Generalized Transformer in Fault Diagnosis of Tennessee Eastman Process

Class Metric Regularized Deep Belief Network with Sparse Representation for Fault Diagnosis

Deep learning of complex process data for fault classification based on sparse probabilistic dynamic network

Generative and Discriminative Infinite Restricted Boltzmann Machine Training

Improved Graph-Regularized Deep Belief Network with Sparse Features Learning for Fault Diagnosis

Dynamic Bayesian Network for Robust Latent Variable Modeling and Fault Classification

Fault Diagnosis for Transformers Based on the Restricted Boltzmann Machine with Gaussian Noises

A Pairwise Graph Regularized Constraint Based on Deep Belief Network for Fault Diagnosis.

Deep Discriminative Sparse Representation Learning for Machinery Fault Diagnosis

Batch Process Fault Diagnosis Based on The Combination of Deep Belief Network and Long Short-Term Memory Network

Machine Fault Classification Using Deep Belief Network.

Multi‐block Gated Recurrent Unit Network‐based Fault Diagnosis Method for Multivariate Nonlinear Process

Machine fault diagnosis based on Gaussian mixture model and its application

A Deep Boltzmann Machine and Multi-Grained Scanning Forest Ensemble Collaborative Method and Its Application to Industrial Fault Diagnosis

An Ensemble Learning Algorithm for Machinery Fault Diagnosis Based on Convolutional Neural Network and Gradient Boosting Decision Tree

Sparse Group Restricted Boltzmann Machines