Abstract:The motivations of users to make interactions can be divided into static preference and dynamic interest. To accurately model user representations over time, recent studies in sequential recommendation utilize information propagation and evolution to mine from batches of arriving interactions. However, they ignore the fact that people are easily influenced by the recent actions of other users in the contextual scenario, and applying evolution across all historical interactions dilutes the importance of recent ones, thus failing to model the evolution of dynamic interest accurately. To address this issue, we propose a Context-Aware Pseudo-Multi-Task Recommender System (CPMR) to model the evolution in both historical and contextual scenarios by creating three representations for each user and item under different dynamics: static embedding, historical temporal states, and contextual temporal states. To dually improve the performance of temporal states evolution and incremental recommendation, we design a Pseudo-Multi-Task Learning (PMTL) paradigm by stacking the incremental single-target recommendations into one multi-target task for joint optimization. Within the PMTL paradigm, CPMR employs a shared-bottom network to conduct the evolution of temporal states across historical and contextual scenarios, as well as the fusion of them at the user-item level. In addition, CPMR incorporates one real tower for incremental predictions, and two pseudo towers dedicated to updating the respective temporal states based on new batches of interactions. Experimental results on four benchmark recommendation datasets show that CPMR consistently outperforms state-of-the-art baselines and achieves significant gains on three of them. The code is available at: <a class="link-external link-https" href="https://github.com/DiMarzioBian/CPMR" rel="external noopener nofollow">this https URL</a>.

Multi-Task Recommendation with Task Information Decoupling

Multi-Task Learning with Sequential Dependence Toward Industrial Applications: A Systematic Formulation

DTN: Deep Multiple Task-specific Feature Interactions Network for Multi-Task Recommendation

Cross-Task Knowledge Distillation in Multi-Task Recommendation

Equitable Multi-task Learning

M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework

Multi-Task Recommendations with Reinforcement Learning

Multi-Faceted Hierarchical Multi-Task Learning for a Large Number of Tasks with Multi-dimensional Relations

Towards Personalized Federated Multi-Scenario Multi-Task Recommendation

DMMP: A distillation-based multi-task multi-tower learning model for personalized recommendation

Deep Mutual Learning across Task Towers for Effective Multi-Task Recommender Learning

Efficient Multi-task Prompt Tuning for Recommendation

Multi-Task Learning with Calibrated Mixture of Insightful Experts

DEPHN: Different Expression Parallel Heterogeneous Network using virtual gradient optimization for Multi-task Learning

Automatic Multi-Task Learning Framework with Neural Architecture Search in Recommendations

AdaTT: Adaptive Task-to-Task Fusion Network for Multitask Learning in Recommendations

STEM: Unleashing the Power of Embeddings for Multi-task Recommendation

CPMR: Context-Aware Incremental Sequential Recommendation with Pseudo-Multi-Task Learning

Personalized Multi-task Training for Recommender System

Deep Task-specific Bottom Representation Network for Multi-Task Recommendation

Progressive Layered Extraction (PLE): A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations