Abstract:Although fuzzy system (FS) is highly interpretable, it is difficult to address high-dimensional big data due to the curse of dimensionality. On the contrary, deep neural network (DNN), a fashion deep learning algorithm, can deal with high-dimensional big data with shortcomings of complex model, huge calculation, and poor interpretability. We present a model of random locally optimized deep fuzzy system (RLODFS) and four specific heuristic implementation algorithms, which combines the advantages of high interpretability of FS and great ability of processing high-dimensional big data of DNN. This method takes Wang-Mendel (WM) algorithm as the basic module, to construct a RLODFS by bottom-up parallel structure. Through hierarchical, random group and combination-based learning, and input sharing, it can retain the interpretability and dramatically improve the computational efficiency. The input variables of the low-dimensional FS are randomly grouped by isometric sampling. Four implementation algorithms of RLODFS based on random local search for optimal combination, group learning, and deep structure with 0, 1, 2, and 3 input sharing, respectively, named as RLODFS-S0, RLODFS-S1, RLODFS-S2, and RLODFS-S3, are developed for regression-oriented problems. Using local loops to find the best combination of parameters, our final algorithms, RLODFS, can achieve fast convergence in training phase, and also superior generalization performance in testing. Compared with six classic algorithms in 12 datasets, the proposed RLODFS algorithms are not only highly interpretable with just some fuzzy rules but also can achieve higher precision, less complexity, and better generalization. Furthermore, it can be used for training fuzzy systems on datasets of any size, particularly for big datasets. Relatively, RLODFS-S3 and RLODFS-S2 achieve the best in comprehensive performance. More importantly, the proposed RLODFS is a new promising method of deep learning with good interpretability and high accuracy.

DF classification algorithm for constructing a small sample size of data-oriented DF regression model

Deep Learning for Industrial Image: Challenges, Methods for Enriching the Sample Space and Restricting the Hypothesis Space, and Possible Issue

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Deep ensemble forests for industrial fault classification

A Deep Non-Connectionist Learning Framework for Industrial Data Modeling

An improved deep forest for alleviating the data imbalance problem

Deep Residual Principal Component Analysis As Feature Engineering for Industrial Data Analytics

Data-driven decision support for rail traffic control: A predictive approach

Deep Learning of Latent Variable Models for Industrial Process Monitoring

Deep Fuzzy System Algorithms Based on Deep Learning and Input Sharing for Regression Application

Data-Driven Soft Sensor Development Based on Deep Learning Technique

An Enhanced Deep Forest Rolling Bearing Fault Diagnosis Method

A Sparse Fault Degradation Oriented Fisher Discriminant Analysis (FDFDA) Algorithm for Faulty Variable Isolation and Its Industrial Application

Feature Reconstruction-Regression Network: A Light-Weight Deep Neural Network for Performance Monitoring in the Froth Flotation

CERT-DF: A Computing-Efficient and Robust Distributed Deep Forest Framework with Low Communication Overhead

Deep Fuzzy Rule-based Classification System with Improved Wang-Mendel Method

An Inductive Transfer Regression Framework for Small Sample Modeling in Power Plants

A Deep Neural Network Model using Random Forest to Extract Feature Representation for Gene Expression Data Classification

When are Deep Networks really better than Decision Forests at small sample sizes, and how?

Implementation of a Scalable Decision Forest Model Based on Information Theory

Compression and regularized optimization of modules stacked residual deep fuzzy system with application to time series prediction