Abstract:Geo-sensory time series, such as the air quality and water distribution, are collected from numerous sensors at different geospatial locations in the same time interval. Each sensor monitors multiple parameters and generates multivariate time series. These time series change over time and vary geographically; hence, geo-sensory time series contain multi-scale spatial-temporal correlations, namely inter-sensor spatial-temporal correlations and intra-sensor spatial-temporal correlations. To capture spatial-temporal correlations, although various deep learning models have been developed, few of the models focus on capturing both correlations. To solve this problem, we propose simultaneously capture the inter- and intra-sensor spatial-temporal correlations by designing a joint network of non-linear graph attention and temporal attraction force(J-NGT) consisting two graph attention mechanisms. The non-linear graph attention mechanism can characterize node affinities for adaptively selecting the relevant exogenous series and relevant sensor series. The temporal attraction force mechanism can weigh the effect of past values on current values to represent the temporal correlation. To prove the superiority and effectiveness of our model, we evaluate our model in three real-world datasets from different fields. Experimental results show that our model can achieve better prediction performance than eight state-of-the-art models, including statistical models, machine learning models, and deep learning models. Furthermore, we conducted experiments to capture inter- and intra-sensor spatial-temporal correlations. Experimental results indicate that our model significantly improves performance by capturing both inter- and intra-sensor spatial-temporal correlations. This fully shows that our model has a greater advantage in geo-sensory time series prediction.

A Multi-Hierarchical Attention-Based Prediction Method on Time Series with Spatio-Temporal Context among Variables

StHCFormer: A Multivariate Ocean Weather Predicting Method Based on Spatiotemporal Hybrid Convolutional Attention Networks

Spatiotemporal Data Prediction Model Based on a Multi-Layer Attention Mechanism

Multi-Horizon Time Series Forecasting with Temporal Attention Learning

A Self-Attention Based Method for Wind Speed Forecasting in High-Speed Railway System

A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction

Hierarchical Time Series Forecasting Based on Temporal Convolution and Attention Mechanism

Attention-based multi-scale prediction network for time-series data

Integrating spatio-positional series attention to deep network for multi-turbine short-term wind power prediction

A spatiotemporal hierarchical attention mechanism-based model for multi-step station-level crowd flow prediction

GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction

Multistage attention network for multivariate time series prediction

Multi-Scale Window Spatiotemporal Attention Network for Subsurface Temperature Prediction and Reconstruction

Correlational graph attention-based Long Short-Term Memory network for multivariate time series prediction

TSARNet :Integrated Spatio-Temporal Attention Mechanism for Multivariate Time Series Prediction Deep Learning Framework

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

A Joint Network of Non-Linear Graph Attention and Temporal Attraction Force for Geo-Sensory Time Series Prediction

Hierarchical Neural Networks for Multivariate Time Series Prediction

A dual-stage attention-based Bi-LSTM network for multivariate time series prediction

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

Temporal Self-Attention-based Conv-LSTM Network for Multivariate Time Series Prediction