Abstract:Next location prediction is helpful for service recommendation, public safety, intelligent transportation, and other location-based applications. Existing location prediction methods usually use sparse check-in trajectories and require massive historical data to capture complex spatial-temporal correlations. High spatial-temporal resolution trajectories have rich information. However, obtaining personal trajectories with long time series and high spatio-temporal resolution usually proves challenging. Herein, this paper proposes a two-stage Context-Aware Spatial-Temporal Location Embedding (CASTLE) model, a multi-modal pre-training model for sequence-to- sequence prediction tasks. The method is built in two steps. First, large-scale location datasets, which are sparse but easier to be acquired (i.e., check-in and anomalous navigation data), are used for pre-training location embedding to capture the multi-functional properties under different contexts. After that, the learned contextual embedding is used for downstream location prediction in small-scale but higher spatio-temporal resolution trajectory datasets. Specifically, the CASTLE model combines Bidirectional and Auto-Regressive Transformers to generate contextual embedding vectors rather than a fixed vector for each location. Furthermore, we introduce a location and time-aware encoder to reflect the spatial distances between locations and visit times. Experiments are conducted on two real trajectory datasets. The results show that the CASTLE model can pre-train beneficial location embedding and outperforms the model without pre-training by 4.6–7.1%. The proposed method is expected to improve the next location prediction accuracy without massive historical data, which will greatly drive the use of trajectory data.

Predict the Next Location from Trajectory Based on Spatiotemporal Sequence.

A System for Destination and Future Route Prediction Based on Trajectory Mining

Trajectory Prediction Based on the Notion of Time and the Influence of Location of Historical Time Step

Position Prediction System Based on Spatio-Temporal Regularity of Object Mobility.

Predicting Next Points of Interests Based on a Markov Model

Improving Location Prediction Based on the Spatial-Temporal Trajectory.

Predicting Future Locations with Semantic Trajectories

Time Mode Based Next Position Prediction System.

HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction.

Exploring Nonlinear Spatiotemporal Effects for Personalized Next Point-of-interest Recommendation

Origin-Aware Location Prediction Based on Historical Vehicle Trajectories.

Spatial and Temporal Mobility Analysis in LTE Mobile Network

Going Where, by Whom, and at What Time: Next Location Prediction Considering User Preference and Temporal Regularity

Mobile User Trajectory Prediction Based on Machine Learning

CASTLE: A CONTEXT-AWARE SPATIAL-TEMPORAL LOCATION EMBEDDING PRE-TRAINING MODEL FOR NEXT LOCATION PREDICTION

TrajGEOS: Trajectory Graph Enhanced Orientation-based Sequential Network for Mobility Prediction

Exploring Trajectory Prediction Through Machine Learning Methods

A Next Location Predicting Approach Based on a Recurrent Neural Network and Self-attention.

A Novel Trajectory Similarity–based Approach for Location Prediction

TTDM: A Travel Time Difference Model for Next Location Prediction