Abstract: Given a sequence of sets, where each set is associated with a timestamp and contains an arbitrary number of elements, the task of temporal sets prediction aims to predict the elements in the subsequent set. Previous studies for temporal sets prediction mainly capture each user's evolutionary preference by learning from his/her own sequence. Although insightful, we argue that: 1) the collaborative signals latent in different users' sequences are essential but have not been exploited; 2) users also tend to show stationary preferences while existing methods fail to consider. To this end, we propose an integrated learning framework to model both the evolutionary and the stationary preferences of users for temporal sets prediction, which first constructs a universal sequence by chronologically arranging all the user-set interactions, and then learns on each user-set interaction. In particular, for each user-set interaction, we first design an evolutionary user preference modelling component to track the user's time-evolving preference and exploit the latent collaborative signals among different users. This component maintains a memory bank to store memories of the related user and elements, and continuously updates their memories based on the currently encoded messages and the past memories. Then, we devise a stationary user preference modelling module to discover each user's personalized characteristics according to the historical sequence, which adaptively aggregates the previously interacted elements from dual perspectives with the guidance of the user's and elements' embeddings. Finally, we develop a set-batch algorithm to improve the model efficiency, which can create time-consistent batches in advance and achieve 3.5x training speedups on average. Experiments on real-world datasets demonstrate the effectiveness and good interpretability of our approach.

Deep Heterogeneous Network for Temporal Set Prediction

Dual Sequential Network for Temporal Sets Prediction

Predicting Temporal Sets with Deep Neural Networks

Continuous-Time User Preference Modelling for Temporal Sets Prediction

Sequential Recommendation on Dynamic Heterogeneous Information Network

Predicting Temporal Sets with Simplified Fully Connected Networks.

Incorporating Temporal Information for Recommendation in Heterogeneous Information Network

Modelling Evolutionary and Stationary User Preferences for Temporal Sets Prediction

Element-guided Temporal Graph Representation Learning for Temporal Sets Prediction

Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNN

Simplifying Temporal Heterogeneous Network for Continuous-Time Link Prediction

(HTNE)-T-2: Temporal Heterogeneous Information Network Embedding in Hyperbolic Spaces

H<SUP>2</SUP>TNE: Temporal Heterogeneous Information Network Embedding in Hyperbolic Spaces

HTP: Exploiting Holistic Temporal Patterns for Sequential Recommendation

Adaptive time series prediction and recommendation

HTDA: Hierarchical Time-Based Directional Attention Network for Sequential User Behavior Modeling.

SDHNet: a Sampling-Based Dual-Stream Hybrid Network for Long-Term Time Series Forecasting

Tackling higher-order relations and heterogeneity: Dynamic heterogeneous hypergraph network for spatiotemporal activity prediction

HTGN-BTW: Heterogeneous Temporal Graph Network with Bi-Time-Window Training Strategy for Temporal Link Prediction

TMP: Meta-path Based Recommendation on Time-Weighted Heterogeneous Information Networks

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture