Abstract:Fuzzy cognitive map (FCM) has been successfully applied to time series prediction due to its powerful dynamic system modeling and inference ability. Although many FCM-based methods have been proposed, their performance is far from satisfactory. The existing FCM-based methods have two limitations: First, the feature extraction of some methods is unreasonable and even leads to overfitting. Second, most methods ignore the local temporal features of time series. In this work, we propose a novel framework for time series prediction based on long short-term memory (LSTM) and high-order FCMs (HFCM) with an attention mechanism, termed LSTM-HFCM AM . To overcome the first limitation, different from other FCM-based methods that use Autoencoder to forcibly decompose each point of the time series into multiple points to represent the original sequences, we use a sliding window to preprocess the original time series and use the Encoder-Decoder framework to represent the sequences. This way makes the model has better generalization and interpretability. Then, HFCM is used to predict representations of sequences due to its powerful causal inference ability. Finally, self-attention is applied to restore the predicted sliding window data with focus, effectively improving the performance. To overcome the second limitation, we use the LSTM to learn the temporal features of time series fragments, thereby learning the local features of the whole time series. We validate the performance of LSTM-HFCM AM on twelve benchmark datasets. Compared with current methods, LSTM-HFCM AM has a maximum improvement of 51.02%. The experimental results demonstrate the effectiveness of LSTM-HFCM AM and overcome the above limitations.

A Hidden Markov Model-based fuzzy modeling of multivariate time series

A System of Time Series Data Mining Based on Hybrid Model

A Fuzzy-Rough Based Approach For Time-Series Prediction

A prediction algorithm for time series based on adaptive model selection

A Novel Fuzzy Time Series Forecasting Model Based on Multiple Linear Regression and Time Series Clustering

Learning High-Order Fuzzy Cognitive Maps Via Multimodal Artificial Bee Colony Algorithm and Nearest-Better Clustering: Applications on Multivariate Time Series Prediction

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction

Time-Series Forecasting Via Fuzzy-Probabilistic Approach with Evolving Clustering-Based Granulation

A Fuzzy C-means Clustering-Based Hybrid Multivariate Time Series Prediction Framework with Feature Selection

Improved Hidden Markov Model and Its Application in Financial Forecasting

Bayesian network based probabilistic weighted high-order fuzzy time series forecasting

pTSE: A Multi-model Ensemble Method for Probabilistic Time Series Forecasting

Mining Complex Time-Series Data by Learning Markovian Models

Event Recognition with Time Varying Hidden Markov Model

Fuzzy-clustering and fuzzy network based interpretable fuzzy model for prediction

Fuzzy Time Series Forecasting Based on Hesitant Fuzzy Sets and Fuzzy C-means Clustering

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

A Novel Hybrid SBM Clustering Method Based on Fuzzy Time Series

A Hidden Markov Model Representing The Spatial And Temporal Correlation Of Multiple Wind Farms

A Causal Stacking Hidden Markov Model for Time Series Forecasting