Abstract:Behavior tracing or predicting is a key component in various application scenarios like online user modeling and ubiquitous computing, which significantly benefits the system design (e.g., resource pre-caching) and improves the user experience (e.g., personalized recommendation). Traditional behavior tracing methods like Markovian and sequential models take recent behaviors as input and infer the next move by using the most real-time information. However, these existing methods rarely comprehensively model the low-level temporal irregularity in the recent behavior sequence, i.e., the unevenly distributed time intervals between consecutive behaviors, and the high-level periodicity in the long-term activity cycle, i.e., the periodic behavior patterns of each user. In this paper, we propose an intuitive and effective embedding method called Multi-level Aligned Temporal Embedding (MATE), which can tackle the temporal irregularity of recent behavior sequence and then align with the long-term periodicity in the activity cycle. Specifically, we combine time encoding and decoupled attention mechanism to build a temporal self-attentive sequential decoder to address the behavior-level temporal irregularity. To embed the activity cycle from the raw behavior sequence, we employ a novel temporal dense interpolation followed by a self-attentive sequential encoder. Then we first propose the periodic activity alignment to capture the long-term activity-level periodicity and construct the activity-behavior alignment to combine the activity-level with behavior-level representation to make the final prediction. We experimentally prove the effectiveness of the proposed model on a game player behavior sequence dataset and a real-world App usage trace dataset. Further, we deploy the proposed behavior tracing model into a game scene preloading service which can effectively reduce the waiting time of scene transfer by preloading the predicted game scene for each user.

Exploring The Interaction Effects for Temporal Spatial Behavior Prediction

Deep Behavior Tracing with Multi-level Temporality Preserved Embedding

Incorporating Heterogeneous User Behaviors and Social Influences for Predictive Analysis

Modeling dynamic spatiotemporal user preference for location prediction: a mutually enhanced method

Revisiting the Temporal Modeling in Spatio-Temporal Predictive Learning under A Unified View

Hierarchical Temporal–spatial Preference Modeling for User Consumption Location Prediction in Geo-Social Networks

Event2Vec: Learning Event Representations Using Spatial-Temporal Information for Recommendation

Spatio-Temporal Modeling of Users' Check-ins in Location-Based Social Networks

Learning the Joint Representation of Heterogeneous Temporal Events for Clinical Endpoint Prediction

CEPR: A Collaborative Exploration and Periodically Returning Model for Location Prediction

A Time-Aware Trajectory Embedding Model for Next-Location Recommendation.

Modeling Interdependent and Periodic Real-World Action Sequences

Learning Evolving User’s Behaviors on Location-Based Social Networks

Calendar Graph Neural Networks for Modeling Time Structures in Spatiotemporal User Behaviors

Modelling Evolutionary and Stationary User Preferences for Temporal Sets Prediction

HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

Personalized Location Prediction for Group Travellers from Spatial-Temporal Trajectories

Venue2Vec: an Efficient Embedding Model for Fine-Grained User Location Prediction in Geo-Social Networks.

Multi-Temporal Relationship Inference in Urban Areas

Modeling Travel Behavior Similarity With Trajectory Embedding

Pedestrian trajectory prediction based on spatio-temporal attention mechanism