Abstract:Mobility prediction plays an important role in a wide range of location-based applications and services. However, there are three problems in the existing literature: (1) explicit high-order interactions of spatio-temporal features are not systemically modeled; (2) most existing algorithms place attention mechanisms on top of recurrent network, so they can not allow for full parallelism and are inferior to self-attention for capturing long-range dependence; (3) most literature does not make good use of long-term historical information and do not effectively model the long-term periodicity of users. To this end, we propose MoveNet and RLMoveNet. MoveNet is a self-attention-based sequential model, predicting each user’s next destination based on her most recent visits and historical trajectory. MoveNet first introduces a cross-based learning framework for modeling feature interactions. With self-attention on both the most recent visits and historical trajectory, MoveNet can use an attention mechanism to capture the user’s long-term regularity in a more efficient way. Based on MoveNet, to model long-term periodicity more effectively, we add the reinforcement learning layer and named RLMoveNet. RLMoveNet regards the human mobility prediction as a reinforcement learning problem, using the reinforcement learning layer as the regularization part to drive the model to pay attention to the behavior with periodic actions, which can help us make the algorithm more effective. We evaluate both of them with three real-world mobility datasets. MoveNet outperforms the state-of-the-art mobility predictor by around 10% in terms of accuracy, and simultaneously achieves faster convergence and over 4x training speedup. Moreover, RLMoveNet achieves higher prediction accuracy than MoveNet, which proves that modeling periodicity explicitly from the perspective of reinforcement learning is more effective.

Predicting the Next Location: A Self‐attention and Recurrent Neural Network Model with Temporal Context

A Next Location Predicting Approach Based on a Recurrent Neural Network and Self-attention.

TCSA-Net: A Temporal-Context-Based Self-Attention Network for Next Location Prediction

Context-aware multi-head self-attentional neural network model for next location prediction

Spatial-Temporal Context-Aware Location Prediction Based on Bidirectional Self-Attention Network

Predicting Mobile Users' Next Location Using the Semantically Enriched Geo-Embedding Model and the Multilayer Attention Mechanism

Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts

Going Where, by Whom, and at What Time: Next Location Prediction Considering User Preference and Temporal Regularity

Augmented Intention Model for Next-Location Prediction from Graphical Trajectory Context

MDAN: Multimodal Double-Layer Attention Network for Next-Location Prediction

GNN-based long and short term preference modeling for next-location prediction

Predicting Activity and Location with Multi-task Context Aware Recurrent Neural Network.

A Spatial-Temporal Self-Attention Network (STSAN) for Location Prediction

Predicting Human Mobility with Self-attention and Feature Interaction.

Next Point-Of-Interest Recommendation With Temporal And Multi-Level Context Attention

Future locations prediction with multi-graph attention networks based on spatial–temporal LSTM framework

Multi-Context Integrated Deep Neural Network Model for Next Location Prediction.

Predict the Next Location from Trajectory Based on Spatiotemporal Sequence.

A Spatial-Temporal-Semantic Neural Network Algorithm for Location Prediction on Moving Objects.

Predicting Next Useful Location With Context-Awareness: The State-Of-The-Art

Predicting Human Mobility with Reinforcement-Learning-Based Long-Term Periodicity Modeling