Abstract:We establish a fuzzy deep model called the fuzzy deep belief net (FDBN) based on fuzzy restricted Boltzmann machines (FRBMs) due to their excellent generative and discriminative properties. The learning procedure of an FDBN is divided into a pretraining phase and a subsequent fine-tuning phase. In the pretraining phase, a group of FRBMs is trained in a greedy layerwise way: the first FRBM is trained by original samples, and the average values of the left and right probabilities produced by its hidden units are treated as the training data for subsequent FRBMs. The resulting FDBN is either a generative or a discriminative model depending on the choice of training a generative or a discriminative type of FRBM on top. Then, a hybrid learning approach is proposed to fine-tune this novel fuzzy deep model: the well pretrained fuzzy parameters are first defuzzified, and the FDBN with defuzzified parameters is fine-tuned by the wakesleep or stochastic gradient descent algorithm. This hybrid strategy not only avoids learning an intractable fuzzy neural network, but also greatly improves the classification capability of the FDBN. The experimental results on MNIST, NORB, and 15 Scene databases indicate that the FDBN with the hybrid learning approach can handle high-dimensional raw images directly. It inherits the fine nature of the FRBM and outperforms some state-of-the-art discriminative models in classification accuracy. Moreover, it shows better capability of robustness than a deep belief net when encountering noisy data.

Deep Fuzzy Systems

On the Design of Neural-Fuzzy Control System

A New Algorithm of Fuzzy Identification for Dynamic Systems

A Survey on Fuzzy Deep Neural Networks

A Hierarchical Fuzzy System with Automatical Rule Extraction

Decomposed Fuzzy Systems and Their Application in Direct Adaptive Fuzzy Control

Iterative Interval Estimation-Based Fault Detection for Discrete Time T-S Fuzzy Systems.

Fuzzy Model Structure of Complex Systems and Its Recursive Identification Method

Fuzzy Extreme Learning Machine for A Class of Fuzzy Inference Systems

A Software Development System for Fuzzy Control

Fuzzy System with Adaptive Rulebase

Fuzzy Time Series and Its Models

A Fuzzy Elman Neural Network

Fuzzy Modeling - An Adaptive Approach

New Delay-Dependent Stability Analysis for Fuzzy Time-Delay Interconnected Systems.

Fuzzy logic systems and medical applications

A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-dimensional Data Classification

Advanced Fuzzy Systems Design and Applications

Fuzzy fractional Shallow Water Wave equations: Analysis, convergence of solutions, and comparative study with depth as Triangular Fuzzy Number

A Fuzzy Identification Method via Fuzzy Rules