Abstract:User profiling and region analysis are two tasks of significant commercial value. However, in practical applications, modeling different features typically involves four main steps: data preparation, data processing, model establishment, evaluation, and optimization. This process is time-consuming and labor-intensive. Repeating this workflow for each feature results in abundant development time for tasks and a reduced overall volume of task development. Indeed, human mobility data contains a wealth of information. Several successful cases suggest that conducting in-depth analysis of population movement data could potentially yield meaningful profiles about users and areas. Nonetheless, most related works have not thoroughly utilized the semantic information within human mobility data and trained on a fixed number of the regions. To tap into the rich information within population movement, based on the perspective that Regions Are Who walk them, we propose a large spatiotemporal model based on trajectories (RAW). It possesses the following characteristics: 1) Tailored for trajectory data, introducing a GPT-like structure with a parameter count of up to 1B; 2) Introducing a spatiotemporal fine-tuning module, interpreting trajectories as collection of users to derive arbitrary region embedding. This framework allows rapid task development based on the large spatiotemporal model. We conducted extensive experiments to validate the effectiveness of our proposed large spatiotemporal model. It's evident that our proposed method, relying solely on human mobility data without additional features, exhibits a certain level of relevance in user profiling and region analysis. Moreover, our model showcases promising predictive capabilities in trajectory generation tasks based on the current state, offering the potential for further innovative work utilizing this large spatiotemporal model.

UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces

UniTraj: Universal Human Trajectory Modeling from Billion-Scale Worldwide Traces

UniTraj: A Unified Framework for Scalable Vehicle Trajectory Prediction

TrajAgent: An Agent Framework for Unified Trajectory Modelling

ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model

UniTE: A Survey and Unified Pipeline for Pre-training Spatiotemporal Trajectory Embeddings

trajdata: A Unified Interface to Multiple Human Trajectory Datasets

Regions are Who Walk Them: a Large Pre-trained Spatiotemporal Model Based on Human Mobility for Ubiquitous Urban Sensing

Deciphering Movement: Unified Trajectory Generation Model for Multi-Agent

A Universal Model for Human Mobility Prediction

UVTM: Universal Vehicle Trajectory Modeling with ST Feature Domain Generation

TrajBERT: BERT-Based Trajectory Recovery with Spatial-Temporal Refinement for Implicit Sparse Trajectories

Learning Universal Trajectory Representation via a Siamese Geography-Aware Transformer

TrajCogn: Leveraging LLMs for Cognizing Movement Patterns and Travel Purposes from Trajectories

MTrajRec

DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Model

Towards Unified Representation Learning for Career Mobility Analysis with Trajectory Hypergraph

MRGTraj: A Novel Non-Autoregressive Approach for Human Trajectory Prediction

TrajFM: A Vehicle Trajectory Foundation Model for Region and Task Transferability

SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model

Unitr: A unified and efficient multi-modal transformer for bird's-eye-view representation