Abstract:Fuzzy cognitive map (FCM) has been successfully applied to time series prediction due to its powerful dynamic system modeling and inference ability. Although many FCM-based methods have been proposed, their performance is far from satisfactory. The existing FCM-based methods have two limitations: First, the feature extraction of some methods is unreasonable and even leads to overfitting. Second, most methods ignore the local temporal features of time series. In this work, we propose a novel framework for time series prediction based on long short-term memory (LSTM) and high-order FCMs (HFCM) with an attention mechanism, termed LSTM-HFCM AM . To overcome the first limitation, different from other FCM-based methods that use Autoencoder to forcibly decompose each point of the time series into multiple points to represent the original sequences, we use a sliding window to preprocess the original time series and use the Encoder-Decoder framework to represent the sequences. This way makes the model has better generalization and interpretability. Then, HFCM is used to predict representations of sequences due to its powerful causal inference ability. Finally, self-attention is applied to restore the predicted sliding window data with focus, effectively improving the performance. To overcome the second limitation, we use the LSTM to learn the temporal features of time series fragments, thereby learning the local features of the whole time series. We validate the performance of LSTM-HFCM AM on twelve benchmark datasets. Compared with current methods, LSTM-HFCM AM has a maximum improvement of 51.02%. The experimental results demonstrate the effectiveness of LSTM-HFCM AM and overcome the above limitations.

PT-LSTM: Extending LSTM for Efficient Processing Time Attributes in Time Series Prediction

Unlocking the Power of LSTM for Long Term Time Series Forecasting

Time Series Prediction Based on LSTM-Attention-LSTM Model

TE-LSTM: A Prediction Model for Temperature Based on Multivariate Time Series Data

Deep Learning with Long Short-Term Memory for Time Series Prediction

xLSTMTime : Long-term Time Series Forecasting With xLSTM

Simplified Long Short-Term Memory Model for Robust and Fast Prediction

Fuzzy inference-based LSTM for long-term time series prediction

Time Series Prediction Method Based on Variant LSTM Recurrent Neural Network

Extreme-Long-short Term Memory for Time-series Prediction

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Simplifying Long Short-Term Memory for Fast Training and Time Series Prediction

T-LSTM: A Long Short-Term Memory Neural Network Enhanced by Temporal Information for Traffic Flow Prediction

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

D-LSTM: Short-Term Road Traffic Speed Prediction Model Based on GPS Positioning Data

HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction.

EA-LSTM: Evolutionary attention-based LSTM for time series prediction

AT-LSTM: An Attention-based LSTM Model for Financial Time Series Prediction

HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

SALSTM: Segmented Self-Attention Long Short-Term Memory for Long-Term Forecasting

A Time Series Prediction Model Based on Long Short-Term Memory Networks