Abstract:Fuzzy cognitive map (FCM) has been successfully applied to time series prediction due to its powerful dynamic system modeling and inference ability. Although many FCM-based methods have been proposed, their performance is far from satisfactory. The existing FCM-based methods have two limitations: First, the feature extraction of some methods is unreasonable and even leads to overfitting. Second, most methods ignore the local temporal features of time series. In this work, we propose a novel framework for time series prediction based on long short-term memory (LSTM) and high-order FCMs (HFCM) with an attention mechanism, termed LSTM-HFCM AM . To overcome the first limitation, different from other FCM-based methods that use Autoencoder to forcibly decompose each point of the time series into multiple points to represent the original sequences, we use a sliding window to preprocess the original time series and use the Encoder-Decoder framework to represent the sequences. This way makes the model has better generalization and interpretability. Then, HFCM is used to predict representations of sequences due to its powerful causal inference ability. Finally, self-attention is applied to restore the predicted sliding window data with focus, effectively improving the performance. To overcome the second limitation, we use the LSTM to learn the temporal features of time series fragments, thereby learning the local features of the whole time series. We validate the performance of LSTM-HFCM AM on twelve benchmark datasets. Compared with current methods, LSTM-HFCM AM has a maximum improvement of 51.02%. The experimental results demonstrate the effectiveness of LSTM-HFCM AM and overcome the above limitations.

Time Series Modeling with Fuzzy Cognitive Maps Based on Partitioning Strategies

Application Research in Stock Market Forecast with Fuzzy Cognitive Maps

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

A combination of traditional time series forecasting models with fuzzy learning neural networks

A Fuzzy-Rough Based Approach For Time-Series Prediction

Model inference of a dynamic system by fuzzy learning of geometric structures

Convex Optimization Based High-Order Fuzzy Cognitive Map Modeling and Its Application in Time Series Predicting

Learning High-Order Fuzzy Cognitive Maps Via Multimodal Artificial Bee Colony Algorithm and Nearest-Better Clustering: Applications on Multivariate Time Series Prediction

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Time series forecasting based on kernel mapping and high-order fuzzy cognitive maps

Traffic Flow Predicting Of Chaos Time Series Using Support Vector Learning Mechanism For Fuzzy Rule-Based Modeling

A Hidden Markov Model-based fuzzy modeling of multivariate time series

Fuzzy Time Series Forecasting Based on Hesitant Fuzzy Sets and Fuzzy C-means Clustering

Time-series forecasting based on fuzzy cognitive maps and GRU-autoencoder

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

Deep Fuzzy Cognitive Maps for Interpretable Multivariate Time Series Prediction

A Multi-SVR Based Fuzzy Modeling Method for Non-Stationary Time Series

Time-Series Forecasting Via Fuzzy-Probabilistic Approach with Evolving Clustering-Based Granulation

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Double Decomposition and Fuzzy Cognitive Graph-Based Prediction of Non-Stationary Time Series

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction