Abstract:Although fuzzy system (FS) is highly interpretable, it is difficult to address high-dimensional big data due to the curse of dimensionality. On the contrary, deep neural network (DNN), a fashion deep learning algorithm, can deal with high-dimensional big data with shortcomings of complex model, huge calculation, and poor interpretability. We present a model of random locally optimized deep fuzzy system (RLODFS) and four specific heuristic implementation algorithms, which combines the advantages of high interpretability of FS and great ability of processing high-dimensional big data of DNN. This method takes Wang-Mendel (WM) algorithm as the basic module, to construct a RLODFS by bottom-up parallel structure. Through hierarchical, random group and combination-based learning, and input sharing, it can retain the interpretability and dramatically improve the computational efficiency. The input variables of the low-dimensional FS are randomly grouped by isometric sampling. Four implementation algorithms of RLODFS based on random local search for optimal combination, group learning, and deep structure with 0, 1, 2, and 3 input sharing, respectively, named as RLODFS-S0, RLODFS-S1, RLODFS-S2, and RLODFS-S3, are developed for regression-oriented problems. Using local loops to find the best combination of parameters, our final algorithms, RLODFS, can achieve fast convergence in training phase, and also superior generalization performance in testing. Compared with six classic algorithms in 12 datasets, the proposed RLODFS algorithms are not only highly interpretable with just some fuzzy rules but also can achieve higher precision, less complexity, and better generalization. Furthermore, it can be used for training fuzzy systems on datasets of any size, particularly for big datasets. Relatively, RLODFS-S3 and RLODFS-S2 achieve the best in comprehensive performance. More importantly, the proposed RLODFS is a new promising method of deep learning with good interpretability and high accuracy.

Compression and regularized optimization of modules stacked residual deep fuzzy system with application to time series prediction

Multivariate Time Series Prediction with PID-based Residual Compensation

Deep Residual Surrogate Model

Deep Fuzzy Cognitive Maps for Interpretable Multivariate Time Series Prediction

Accurate prediction of short-term photovoltaic power generation via a novel double-input-rule-modules stacked deep fuzzy method

Double Decomposition and Fuzzy Cognitive Graph-Based Prediction of Non-Stationary Time Series

Deep Fuzzy System Algorithms Based on Deep Learning and Input Sharing for Regression Application

Convex Optimization Based High-Order Fuzzy Cognitive Map Modeling and Its Application in Time Series Predicting

Deep Fuzzy Rule-based Classification System with Improved Wang-Mendel Method

Time Series Prediction Using Sparse Autoencoder and High-Order Fuzzy Cognitive Maps

Long-term Prediction of Time Series Using Fuzzy Cognitive Maps

Long-term Prediction of Time Series Based on Fuzzy Cognitive Map and Ensemble Learning

FDF: Flexible Decoupled Framework for Time Series Forecasting with Conditional Denoising and Polynomial Modeling

Disentangled Interpretable Representation for Efficient Long-term Time Series Forecasting

Optimizing Time-Series forecasting using stacked deep learning framework with enhanced adaptive moment estimation and error correction

A Hybrid Method with Adaptive Sub-Series Clustering and Attention-Based Stacked Residual LSTMs for Multivariate Time Series Forecasting

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

Remaining Useful Life Prediction Method Based on Dual-Path Interaction Network with Multiscale Feature Fusion and Dynamic Weight Adaptation

FCM-RDpA: TSK fuzzy regression model construction using fuzzy C-means clustering, regularization, Droprule, and Powerball Adabelief

Deep residual LSTM with domain-invariance for remaining useful life prediction across domains