Abstract:The problem of time series prediction based on fuzzy cognitive maps (FCMs) is unresolved. Although many methods have been proposed to cope with this issue, the performance of these methods is far from satisfactory. Traditional FCM-based predictors have three limitations. First, current feature extraction operators are incapable of learning good representations of original time series. Second, current methods use just the output of FCMs to predict the next value; they do not directly utilize the important information of the latent features. Third, current FCM-based predictors optimize each component individually, thereby leading to low prediction accuracy. For example, these methods first optimize the feature extraction operator and then learn the FCMs from the latent features; they do not simultaneously optimize the whole prediction model. In this article, we develop a framework based on a sparse autoencoder (SAE) and a high-order FCM (HFCM) to address the time series prediction problem; we refer this framework as SAE-FCM. To overcome the first limitation of current methods, an SAE is employed to extract features from original time series. Unlike current FCM-based predictors, our method combines the output of both the SAE and the HFCM to calculate the predicted value, thereby overcoming the second limitation of traditional FCM-based predictors. In an application of the idea of "fine tuning" in deep learning, the weights of SAE-FCM can be updated by the batch gradient descent method if the prediction errors are great. Thus, we can optimize SAE-FCM as a whole and overcome the third limitation. We validate the performance of SAE-FCM on ten datasets. Compared with the experimental results obtained by using state-of-the-art methods, the experimental results obtained by using SAE-FCM demonstrate the effectiveness of our method. Extensive experiments also show that SAE-FCM can effectively overcome t-e above limitations.

What problem does this paper attempt to address?

This paper attempts to address the time series prediction problem based on Fuzzy Cognitive Maps (FCM). Although various methods have been proposed to tackle this issue, their performance has not been satisfactory, mainly due to the following three limitations: 1. **Insufficient feature extraction capability**: Current feature extraction operators fail to learn effective representations from the raw time series. 2. **Underutilization of latent feature information**: Existing methods only use the output of FCM to predict the next value, without directly leveraging the important information of latent features. 3. **Separate optimization approach**: Existing FCM-based predictors typically optimize each component separately, leading to lower overall prediction accuracy. To overcome these limitations, the authors propose a framework based on Sparse Autoencoder (SAE) and High-order Fuzzy Cognitive Maps (HFCM), called SAE-FCM. The main features of this framework are as follows: 1. **Feature extraction using SAE**: Extract features from the raw time series using SAE to obtain better representations. 2. **Combining the outputs of SAE and HFCM**: Combine the outputs of SAE and HFCM to predict the next value, thereby fully utilizing the information of latent features. 3. **Overall optimization**: Fine-tune the entire model using the batch gradient descent method to optimize all weights and avoid local optima. The authors validated the performance of SAE-FCM on 10 datasets and compared it with existing state-of-the-art methods. The results show that SAE-FCM has higher accuracy and effectiveness in time series prediction.

Time Series Prediction Using Sparse Autoencoder and High-Order Fuzzy Cognitive Maps

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

Time-series forecasting based on fuzzy cognitive maps and GRU-autoencoder

Deep Fuzzy Cognitive Maps for Interpretable Multivariate Time Series Prediction

Time series forecasting based on kernel mapping and high-order fuzzy cognitive maps

Convex Optimization Based High-Order Fuzzy Cognitive Map Modeling and Its Application in Time Series Predicting

Learning High-Order Fuzzy Cognitive Maps Via Multimodal Artificial Bee Colony Algorithm and Nearest-Better Clustering: Applications on Multivariate Time Series Prediction

Multivariate Time Series Forecasting Based on Elastic Net and High-Order Fuzzy Cognitive Maps: A Case Study on Human Action Prediction Through EEG Signals

Double Decomposition and Fuzzy Cognitive Graph-Based Prediction of Non-Stationary Time Series

Towards better time series prediction with model-independent, low-dispersion clusters of contextual subsequence embeddings

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

A Fuzzy C-means Clustering-Based Hybrid Multivariate Time Series Prediction Framework with Feature Selection

Fuzzy inference-based LSTM for long-term time series prediction

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

Training Novel Adaptive Fuzzy Cognitive Map by Knowledge-Guidance Learning Mechanism for Large-Scale Time-Series Forecasting

Multi-source Heterogeneous Data Fusion Model Based on FC-SAE

Mechanical fault time series prediction by using EFMSAE-LSTM neural network

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction

CNN-FCM: System modeling promotes stability of deep learning in time series prediction

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction