Abstract:The problem of time series prediction based on fuzzy cognitive maps (FCMs) is unresolved. Although many methods have been proposed to cope with this issue, the performance of these methods is far from satisfactory. Traditional FCM-based predictors have three limitations. First, current feature extraction operators are incapable of learning good representations of original time series. Second, current methods use just the output of FCMs to predict the next value; they do not directly utilize the important information of the latent features. Third, current FCM-based predictors optimize each component individually, thereby leading to low prediction accuracy. For example, these methods first optimize the feature extraction operator and then learn the FCMs from the latent features; they do not simultaneously optimize the whole prediction model. In this article, we develop a framework based on a sparse autoencoder (SAE) and a high-order FCM (HFCM) to address the time series prediction problem; we refer this framework as SAE-FCM. To overcome the first limitation of current methods, an SAE is employed to extract features from original time series. Unlike current FCM-based predictors, our method combines the output of both the SAE and the HFCM to calculate the predicted value, thereby overcoming the second limitation of traditional FCM-based predictors. In an application of the idea of "fine tuning" in deep learning, the weights of SAE-FCM can be updated by the batch gradient descent method if the prediction errors are great. Thus, we can optimize SAE-FCM as a whole and overcome the third limitation. We validate the performance of SAE-FCM on ten datasets. Compared with the experimental results obtained by using state-of-the-art methods, the experimental results obtained by using SAE-FCM demonstrate the effectiveness of our method. Extensive experiments also show that SAE-FCM can effectively overcome t-e above limitations.

Time-series Prediction Using Self-Organizing Fuzzy Neural Networks

A combination of traditional time series forecasting models with fuzzy learning neural networks

A Fuzzy-Rough Based Approach For Time-Series Prediction

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture

Time Series Prediction Using Sparse Autoencoder and High-Order Fuzzy Cognitive Maps

A New Self-organizing Interval Type-2 Fuzzy Neural Network for Multi-Step Time Series Prediction

Self-attention-based time-variant neural networks for multi-step time series forecasting

A self-organizing deep network architecture designed based on LSTM network via elitism-driven roulette-wheel selection for time-series forecasting

Self CNN-based time series stream forecasting

Novel hybrid multi-head self-attention and multifractal algorithm for non-stationary time series prediction

A Chaotic Time Series Prediction Method Based on Fuzzy Neural Network and Its Application

Time-Series Forecasting Via Fuzzy-Probabilistic Approach with Evolving Clustering-Based Granulation

Features Injected Recurrent Neural Networks for Short-Term Traffic Speed Prediction.

Fuzzy inference-based LSTM for long-term time series prediction

Self-organizing deep belief modular echo state network for time series prediction

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

Neural Kalman Filtering for Robust Temporal Recommendation.

A TCN-Linear Hybrid Model for Chaotic Time Series Forecasting

Iterative self-transfer learning: A general methodology for response time-history prediction based on small dataset

A fuzzy derivative model approach to time-series prediction

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction