Abstract:Behavior tracing or predicting is a key component in various application scenarios like online user modeling and ubiquitous computing, which significantly benefits the system design (e.g., resource pre-caching) and improves the user experience (e.g., personalized recommendation). Traditional behavior tracing methods like Markovian and sequential models take recent behaviors as input and infer the next move by using the most real-time information. However, these existing methods rarely comprehensively model the low-level temporal irregularity in the recent behavior sequence, i.e., the unevenly distributed time intervals between consecutive behaviors, and the high-level periodicity in the long-term activity cycle, i.e., the periodic behavior patterns of each user. In this paper, we propose an intuitive and effective embedding method called Multi-level Aligned Temporal Embedding (MATE), which can tackle the temporal irregularity of recent behavior sequence and then align with the long-term periodicity in the activity cycle. Specifically, we combine time encoding and decoupled attention mechanism to build a temporal self-attentive sequential decoder to address the behavior-level temporal irregularity. To embed the activity cycle from the raw behavior sequence, we employ a novel temporal dense interpolation followed by a self-attentive sequential encoder. Then we first propose the periodic activity alignment to capture the long-term activity-level periodicity and construct the activity-behavior alignment to combine the activity-level with behavior-level representation to make the final prediction. We experimentally prove the effectiveness of the proposed model on a game player behavior sequence dataset and a real-world App usage trace dataset. Further, we deploy the proposed behavior tracing model into a game scene preloading service which can effectively reduce the waiting time of scene transfer by preloading the predicted game scene for each user.

Robust User Behavioral Sequence Representation via Multi-scale Stochastic Distribution Prediction

Incorporating Heterogeneous User Behaviors and Social Influences for Predictive Analysis

Learning Robust Representation for Reinforcement Learning with Distractions by Reward Sequence Prediction.

PTUM: Pre-training User Model from Unlabeled User Behaviors Via Self-supervision.

Deep Behavior Tracing with Multi-level Temporality Preserved Embedding

Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling

Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendation

Unsupervised Representation Learning of Player Behavioral Data with Confidence Guided Masking

AdaptSSR: Pre-training User Model with Augmentation-Adaptive Self-Supervised Ranking

Self-supervised progressive graph neural network for enhanced multi-behavior recommendation

CASE: Predict User Behaviors via Collaborative Assistant Sequence Embedding Model

Mixture of Soft Prompts for Controllable Data Generation

InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping

USE: Dynamic User Modeling with Stateful Sequence Models

Learning Transferable User Representations with Sequential Behaviors Via Contrastive Pre-training.

Multi-behavioral Sequential Prediction with Recurrent Log-bilinear Model

Multi-behavior Self-supervised Learning for Recommendation

Learning Universal User Representations via Self-Supervised Lifelong Behaviors Modeling

Beyond the Sequence: Statistics-Driven Pre-training for Stabilizing Sequential Recommendation Model

Multi-Level Sequence Denoising with Cross-Signal Contrastive Learning for Sequential Recommendation

BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendation