Abstract:Fuzzy cognitive map (FCM) has been successfully applied to time series prediction due to its powerful dynamic system modeling and inference ability. Although many FCM-based methods have been proposed, their performance is far from satisfactory. The existing FCM-based methods have two limitations: First, the feature extraction of some methods is unreasonable and even leads to overfitting. Second, most methods ignore the local temporal features of time series. In this work, we propose a novel framework for time series prediction based on long short-term memory (LSTM) and high-order FCMs (HFCM) with an attention mechanism, termed LSTM-HFCM AM . To overcome the first limitation, different from other FCM-based methods that use Autoencoder to forcibly decompose each point of the time series into multiple points to represent the original sequences, we use a sliding window to preprocess the original time series and use the Encoder-Decoder framework to represent the sequences. This way makes the model has better generalization and interpretability. Then, HFCM is used to predict representations of sequences due to its powerful causal inference ability. Finally, self-attention is applied to restore the predicted sliding window data with focus, effectively improving the performance. To overcome the second limitation, we use the LSTM to learn the temporal features of time series fragments, thereby learning the local features of the whole time series. We validate the performance of LSTM-HFCM AM on twelve benchmark datasets. Compared with current methods, LSTM-HFCM AM has a maximum improvement of 51.02%. The experimental results demonstrate the effectiveness of LSTM-HFCM AM and overcome the above limitations.

Univariate Time Series Forecasting With Fuzzy Cmac

Application Research in Stock Market Forecast with Fuzzy Cognitive Maps

Automatic Forecasting Agent for e-Commerce Applications

Intermittent Demand Forecasting with Fuzzy Markov Chain and Multi Aggregation Prediction Algorithm

Time-series forecasting based on fuzzy cognitive maps and GRU-autoencoder

Convex Optimization Based High-Order Fuzzy Cognitive Map Modeling and Its Application in Time Series Predicting

Forecasting Based on High-Order Fuzzy-Fluctuation Trends and Particle Swarm Optimization Machine Learning

Learning High-Order Fuzzy Cognitive Maps Via Multimodal Artificial Bee Colony Algorithm and Nearest-Better Clustering: Applications on Multivariate Time Series Prediction

Multiple-Input Multiple-Output Randomized Fuzzy Cognitive Map Method for High-Dimensional Time Series Forecasting

Econometric Modeling and Economic Forecasting

The Trend-Fuzzy-Granulation-Based Adaptive Fuzzy Cognitive Map for Long-Term Time Series Forecasting

Deep Fuzzy Cognitive Maps for Interpretable Multivariate Time Series Prediction

Training Novel Adaptive Fuzzy Cognitive Map by Knowledge-Guidance Learning Mechanism for Large-Scale Time-Series Forecasting

Functional Coefficient Moving Average Model with Applications to Forecasting Chinese CPI

Time series forecasting based on kernel mapping and high-order fuzzy cognitive maps

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

Masked Multi-Step Multivariate Time Series Forecasting with Future Information

A Hidden Markov Model-based fuzzy modeling of multivariate time series

Modified support vector machines in financial time series forecasting

Particle swarm optimization and intuitionistic fuzzy set-based novel method for fuzzy time series forecasting