Abstract:With the fast development of various positioning techniques such as Global Position System (GPS), mobile devices and remote sensing, spatio-temporal data has become increasingly available nowadays. Mining valuable knowledge from spatio-temporal data is critically important to many real world applications including human mobility understanding, smart transportation, urban planning, public safety, health care and environmental management. As the number, volume and resolution of spatio-temporal datasets increase rapidly, traditional data mining methods, especially statistics based methods for dealing with such data are becoming overwhelmed. Recently, with the advances of deep learning techniques, deep leaning models such as convolutional neural network (CNN) and recurrent neural network (RNN) have enjoyed considerable success in various machine learning tasks due to their powerful hierarchical feature learning ability in both spatial and temporal domains, and have been widely applied in various spatio-temporal data mining (STDM) tasks such as predictive learning, representation learning, anomaly detection and classification. In this paper, we provide a comprehensive survey on recent progress in applying deep learning techniques for STDM. We first categorize the types of spatio-temporal data and briefly introduce the popular deep learning models that are used in STDM. Then a framework is introduced to show a general pipeline of the utilization of deep learning models for STDM. Next we classify existing literatures based on the types of ST data, the data mining tasks, and the deep learning models, followed by the applications of deep learning for STDM in different domains including transportation, climate science, human mobility, location based social network, crime analysis, and neuroscience. Finally, we conclude the limitations of current research and point out future research directions.

Predicting High-Dimensional Time Series Data with Spatial, Temporal and Global Information

DNN-based Prediction Model for Spatio-Temporal Data

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

Spatiotemporal Transformer Neural Network for Time-Series Forecasting

Research on Deep Spatio-Temporal Model and Its Application in Situation Prediction

Wavelet-Driven Spatiotemporal Predictive Learning: Bridging Frequency and Time Variations

Spatial-Temporal Convolutional Transformer Network for Multivariate Time Series Forecasting

STHGCN: A spatiotemporal prediction framework based on higher-order graph convolution networks

Spatiotemporal Information Conversion Machine for Time-Series Forecasting

A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction

Spatiotemporal Attention for Multivariate Time Series Prediction and Interpretation

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

DSTP-RNN: A Dual-Stage Two-Phase Attention-Based Recurrent Neural Network for Long-Term and Multivariate Time Series Prediction

AFSTGCN: Prediction for multivariate time series using an adaptive fused spatial-temporal graph convolutional network

Deep Learning for Spatio-Temporal Data Mining: A Survey

HyperST-Net: Hypernetworks for Spatio-Temporal Forecasting.

Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting

DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series prediction

SA-JSTN: Self-Attention Joint Spatiotemporal Network for Temperature Forecasting

HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

A spatio-temporal LSTM model to forecast across multiple temporal and spatial scales