Abstract:To improve the prediction accuracy of chaotic time series and reconstruct a more reasonable phase space structure of the prediction network, we propose a convoluted neural network-long short-term memory (CNN-LSTM) prediction model based on the incremental attention mechanism. Firstly, a traversal search is conducted through the traversal layer for finite parameters in the phase space. Then, an incremental attention layer is utilized for parameter judgment based on the dimension weight criteria (DWC). The phase space parameters that best meet DWC are selected and fed into the input layer. Finally, the constructed CNN-LSTM network extracts spatiotemporal features and provides the final prediction results. The model is verified using Logistic, Lorenz, and sunspot chaotic time series, and the performance is compared from the two dimensions of prediction accuracy and network phase space structure. Additionally, the CNN-LSTM network based on incremental attention is compared with LSTM, CNN, recurrent neural network (RNN), and support vector regression (SVR) for prediction accuracy. The experiment results indicate that the proposed composite network model possesses enhanced capability in extracting temporal features and achieves higher prediction accuracy. Also, the algorithm to estimate the phase space parameter is compared with the traditional CAO, false nearest neighbor, and C-C, three typical methods for determining the chaotic phase space parameters. The experiments reveal that the phase space parameter estimation algorithm based on the incremental attention mechanism is superior in prediction accuracy compared with the traditional phase space reconstruction method in five networks, CNN-LSTM, LSTM, CNN, RNN, and SVR.

Chaotic time series prediction based on multi-scale attention in a multi-agent environment

Multi-Agent Trajectory Prediction Based on Graph Neural Network

Multi-scale Attention Flow for Probabilistic Time Series Forecasting

Attention-based multi-scale prediction network for time-series data

MMH-STA: A Macro-Micro-Hierarchical Spatio-Temporal Attention Method for Multi-Agent Trajectory Prediction in Unsignalized Roundabouts

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

Spatio-Temporal-Interaction Graph Neural Networks for Multi-Agent Trajectory Prediction

CNN-LSTM based incremental attention mechanism enabled phase-space reconstruction for chaotic time series prediction

Spatial–temporal combination and multi-head flow-attention network for traffic flow prediction

High-efficiency Chaotic Time Series Prediction Based on Time Convolution Neural Network

Hierarchical Attention Network for Planning-informed Multi-Agent Trajectory Prediction

Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking

HSTA: A Hierarchical Spatio-Temporal Attention Model for Trajectory Prediction

A spatiotemporal hierarchical attention mechanism-based model for multi-step station-level crowd flow prediction

Multistage attention network for multivariate time series prediction

Hybrid Attention Networks for Flow and Pressure Forecasting in Water Distribution Systems

Dynamic multi-scale spatial-temporal graph convolutional network for traffic flow prediction

A Graph Attention Based Approach for Trajectory Prediction in Multi-agent Sports Games

Novel hybrid multi-head self-attention and multifractal algorithm for non-stationary time series prediction

Data-driven prediction of large-scale spatiotemporal chaos with distributed low-dimensional models