Abstract:Behavior tracing or predicting is a key component in various application scenarios like online user modeling and ubiquitous computing, which significantly benefits the system design (e.g., resource pre-caching) and improves the user experience (e.g., personalized recommendation). Traditional behavior tracing methods like Markovian and sequential models take recent behaviors as input and infer the next move by using the most real-time information. However, these existing methods rarely comprehensively model the low-level temporal irregularity in the recent behavior sequence, i.e., the unevenly distributed time intervals between consecutive behaviors, and the high-level periodicity in the long-term activity cycle, i.e., the periodic behavior patterns of each user. In this paper, we propose an intuitive and effective embedding method called Multi-level Aligned Temporal Embedding (MATE), which can tackle the temporal irregularity of recent behavior sequence and then align with the long-term periodicity in the activity cycle. Specifically, we combine time encoding and decoupled attention mechanism to build a temporal self-attentive sequential decoder to address the behavior-level temporal irregularity. To embed the activity cycle from the raw behavior sequence, we employ a novel temporal dense interpolation followed by a self-attentive sequential encoder. Then we first propose the periodic activity alignment to capture the long-term activity-level periodicity and construct the activity-behavior alignment to combine the activity-level with behavior-level representation to make the final prediction. We experimentally prove the effectiveness of the proposed model on a game player behavior sequence dataset and a real-world App usage trace dataset. Further, we deploy the proposed behavior tracing model into a game scene preloading service which can effectively reduce the waiting time of scene transfer by preloading the predicted game scene for each user.

Jointly Modeling Heterogeneous Student Behaviors and Interactions among Multiple Prediction Tasks

Learning from Heterogeneous Student Behaviors for Multiple Prediction Tasks

Jointly Modeling Individual Student Behaviors and Social Influence for Prediction Tasks.

Incorporating Heterogeneous User Behaviors and Social Influences for Predictive Analysis

Going Beyond Multi-Task Dense Prediction with Synergy Embedding Models

Multiple Features Fusion Attention Mechanism Enhanced Deep Knowledge Tracing for Student Performance Prediction

A Prediction Model of Student Performance Based on Self-Attention Mechanism

Deep Behavior Tracing with Multi-level Temporality Preserved Embedding

A University Student Performance Prediction Model and Experiment Based on Multi-Feature Fusion and Attention Mechanism

Multilayer LSTM with Global Access Gate for Predicting Students Performance Using Online Behaviors.

Jointly Predicting Future Content in Multiple Social Media Sites Based on Multi-task Learning

Behavior-driven Student Performance Prediction with Tri-branch Convolutional Neural Network

Students Performance Modeling Based on Behavior Pattern

Attention-Based Deep Learning Model for Predicting Collaborations Between Different Research Affiliations

Personalized Behavior Prediction with Encoder-to-Decoder Structure

Student achievement prediction using deep neural network from multi-source campus data

LG-LSTM: Modeling LSTM-Based Interactions for Multi-Agent Trajectory Prediction

Neural Attentive Knowledge Tracing Model for Student Performance Prediction

A Method for Prediction and Analysis of Student Performance That Combines Multi-Dimensional Features of Time and Space

Hierarchical Long Short-Term Concurrent Memory for Human Interaction Recognition

Student behavior recognition based on multitask learning