Abstract:Spatial prediction models hold significant application value in fields such as environmental science, economic development, and geological exploration. With advancements in deep learning technology, graph neural networks (GNNs) offer a powerful and scalable solution for spatial data modeling. In these models, each spatial location is represented as a vertex, with the explanatory variables at each point converted into vertex features, and the vertex label corresponding to the target value at that point. GNNs utilize this representation to predict vertex labels, thereby performing spatial prediction. However, the residuals of GNN predictions are found to still exhibit spatial autocorrelation, indicating that traditional GNNs only achieve suboptimal results in terms of capturing complex spatial relationships. In this paper, we propose a two-stage spatial prediction method called Location Embedded Graph Neural Networks-Residual Neural Processes (LEGNN-RNP) to address this challenge. In the first stage, we employ LEGNNs, a new framework that integrates location features into GNNs through an attention mechanism, enhancing the learning of complex spatial models by considering both spatial context and attribute features. In the second stage, we model the residuals from LEGNN predictions to further extract spatial patterns from the data. Specifically, we introduce RNP, a neural process-based approach to model the Gaussian Process (GP) distribution of residuals. The distribution parameters (i.e., mean and covariance) are parameterized by a neural network, where the mean estimates the residual and the variance quantifies the prediction uncertainty. Experiments on four datasets demonstrate that our proposed two-stage method achieves state-of-the-art results by effectively extracting spatial relationships and significantly improving spatial prediction accuracy.

Location Prediction via Generative Adversarial Network with Spatial Temporal Embedding

HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

A Spatial-Temporal-Semantic Neural Network Algorithm for Location Prediction on Moving Objects.

D-GAN: Deep Generative Adversarial Nets for Spatio-Temporal Prediction

STI-GAN: Multimodal Pedestrian Trajectory Prediction Using Spatiotemporal Interactions and a Generative Adversarial Network

A spatiotemporal graph generative adversarial networks for short-term passenger flow prediction in urban rail transit systems

Predicting Future Locations with Semantic Trajectories

A Spatial-Temporal Attentive Network with Spatial Continuity for Trajectory Prediction

Generative Adversarial Nets Model Based on Spatio-Temporal Graph Attention Network for Multi-Step Prediction

Future locations prediction with multi-graph attention networks based on spatial–temporal LSTM framework

Multi-Modal Pedestrian Trajectory Prediction for Edge Agents Based on Spatial-Temporal Graph

A Novel Trajectory Generator Based on a Constrained GAN and a Latent Variables Predictor

Location and time embedded feature representation for spatiotemporal traffic prediction

DNN-based Prediction Model for Spatio-Temporal Data

Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking

Spatial-Temporal Attention Mechanism and Graph Convolutional Networks for Destination Prediction

Spatial-Temporal Block and LSTM Network for Pedestrian Trajectories Prediction

Robust spatial temporal imputation based on spatio-temporal generative adversarial nets

Long-term 4D trajectory prediction using generative adversarial networks

Multimodal Pedestrian Trajectory Prediction Based on Relative Interactive Spatial-Temporal Graph

A Two-Stage Spatial Prediction Modeling Approach Based on Graph Neural Networks and Neural Processes